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PREFACE 


It has been sale of the THEORY OP GAMES AND -EfilKlIC BgHAVIOR by 
John von Neumann and Oskar Morgenstern that “posterity mhy 'regard thia 
book as one of the major scientific achievements of tjfe first’half of the 
twentieth century." 1 At the beginning of the second hal^Vf' the twentieth 
century the theory of games continues to be an object of vigorous and ex¬ 
panding research, as the papers assembled in the present Study amply 
demonstrate. The authors of these papers have not been content just to 
solve outstanding problems and elaborate existing results but have gone on 
to raise fresh problems and extend the theory in new directions. 

This Study is a sequel to CONTRIBUTIONS TO THE THEORY OF GAMES, 
Volume I (Annals of Mathematics Study No. 2k, Princeton, 1950). The 
continuity of research bridging the two volumes is evidenced by the fact 
that some of the problems posed in the Preface to Study 2k are now solved 
in this Study. On the other hand, some reorganization has taicen place. 

The simple division of Study 2k into two parts, dealing with finite and 
with infinite games*, has been replaced by a division of this Study into 
four parts: finite zero-sum two-person games. Infinite zero-sum two-person 
.games, games in extensive form, and general n-person games. (The mounting 
interest in n-person games and extensive games is quite striking; scarcely 
touched In Study 2k, they now occupy fully half of this Study.) Each of 
the four parts Is prefaced by an introduction that describes the papers 
therein and their interconnections. At the same time these Introductions 
are designed to indicate how the four parts relate to one another. The 
newcomer to game theory is referred to the Preface in Study 2k for a gen¬ 
eral expository Introduction to the problems of contemporary research in 
the field. 


1 A. H. Copeland, Bulletin of the American Mathematical Society 51 (1945) 
p. 498. 
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PREFACE 


The Bibliography at the end of this Study supplements the Bibli¬ 
ography in Study 2k . Recent publications have been added and some omis¬ 
sions filled in, but the previous listings have not been repeated. Many of 
the new items, particularly those in economics journals, have been obtained 
from a bibliography on the theory of games prepared by 0. Morgens tern. 

The editing and preparing of this Study have been done at 
Princeton University, in the Department of Mathematics, as part of the 
work of a Logistics Project sponsored by the Office of Naval Research. 
Members of the Project who have participated in the task have been 
C. H. Bernstein, D. B. Gillies, I. Glicksberg, R. C. Lyndon, H. Mills, 

H. Rogers Jr., R. J. Semple, L. S. Shapley, G- L. Thompson, and the under¬ 
signed. Papers for the Study were refereed by members of the Project with 
the generous assistance of D. Gale, B. R. Gelbaum, G- K. Kalisch, 

J. Laderman, J. P. Mayberry, J. F. Nash, E. D- Nering, and J. von Neumann. 
The typing of the master copy has been the painstaking work of 
Mrs. S. H. Robinson. The good services of the Princeton University Press 
have been ever available through its Science Editor, H. S. Bailey, Jr. 

To all these individuals, for their friendly cooperation, we express our 
sincere thanks. 


December 1952 


H. W. Kuhn 
A. W. Tucker 
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Part I 


FINITE ZERO-SUM TWO-PERSON GAMES 


Finite zero-sum two-person games, keystone of the theory of 
games, now pose few problems that do not pertain to methods of computing 
optimal mixed strategies. (See Study 2k, Preface, Problems 1 and 2.) 

Part I of the present Study provides striking confirmation of this. The 
first paper deals with the equivalence of the solution of a certain game 
with the solution of a seemingly unrelated combinatorial problem; the second 
determines the solutions of two variants of two-person Poker; the third and 
fourth papers present computational methods applicable to all the games 
under consideration; while the fifth paper contains a theorem which Is 
closely related to the criterion that a pure strategy be an active part of 
some optimal mixed strategy. 

The zero-sum two-person game considered by J. von Neumann in 
PAPER 1 might be called Hlde-and-Seek. In the first move, player I "hides" 
in some cell of an n by n grid, with rows Indexed by i = 1, 2, ..., n 
and columns by j = 1, 2, ..., n. In the second move, player II attempts 
to find I's hiding place by guessing either Its row i or its column j. 

If player I is discovered, he must pay the positive penalty de¬ 

pending on the cell (I,j) in which he was hiding; if he Is not discovered, 

p 

the payoff is zero. It is clear that there are n pure strategies for 
player I and 2n pure strategies for player II. Von Neumann shows that 
the solution of this game is equivalent to the "optimal assignment problem," 
which calls for the assignment of n persons to n jobs in such a way as 
to maximize the total value of the assignment, given that the value of the 
Ith person in the jth job is a^j « is stlown that the n by 2n 

game is simpler computationally than examination of the n! possible 
assignments. 

PAPER 2 presents at long last the material promised in a footnote 
on page 196 of the THEORY OF GAMES AND ECONOMIC BEHAVIOR. It gives the 
exhaustive solutions of the original discrete forms of the two variants of 
Poker considered by J. von Neumann and 0. Morgens tern, ibid.. Chapter IV. 
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FINITE ZERO-SUM TWO-PERSON GAMES 


This paper was translated from German notes of J. von Neumann (made In 
1929) and arranged for publication by J. P. Mayberry and D. B. Gillies 
with the active collaboration of Professor von Neumann. 

The "double description method" treated in PAPER 3 is a procedure 
devised by T. S. Motzkin for calculating the full set of solutions of a 
system of linear inequalities and developed independently by H. Raiffa, 

G. L. Thompson and R. M. Thrall as an algorithm for computing the solutions 
of a zero-sum two-person game. Here the four authors have joined forces 
to explain their common method. To find the optimal mixed strategies of 
player I in a game with matrix A = (a.jj), where 1=1, ..., m and 
j = 1, ..., n, they seek those points of the (m - 1)-dimensional simplex 

•$1 l°> •••' °s *, + ••• + im- 1 

over which the (m - 1)-dimensional hypersurface 

z = min (2J ± S-ja-ij) 

J 

attains its maximum elevation. The vertices (extreme points) of this 
concave polyhedral surface are effectively calculated by the double 
description method. The virtues of the method lie in the simplicity of 
the individual steps, each of which amounts to the calculation of the 
intersection of a straight line with a hyperplane, and in the fact that all 
optimal mixed strategies are obtained. In a final section the method is 
applied to a general system of linear inequalities. 

The fact that solutions of zero-sum two-person games can be 
obtained as fixed points of appropriate mappings has been known since the 
original existence proof of von Neumann. M. Dresher and S. Karlin utilize 
this fact in PAPER b to construct an algorithm for the solution of any 
"convex game:" namely, a game determined by a bilinear payoff function 
A(r,s) of mixed strategies r and s, that range over compact convex 
sets in Euclidean m-space and n-space, for players I and II, respectively. 
To such games the authors extend theorems known for finite zero-sum two- 
person games and polynomial-like games, both of which are readily seen to 
constitute subclasses of the class of convex games. 

In PAPER 5 K. J. Arrow, E. W. Barankin, and D. Blackwell 
establish the following theorem concerning a closed convex set S in 
Euclidean n-space. Call a point s - (s^ ..., s n ) of S "admissible" 
if there is no point t - (t 1 , ..., t ) in S that is distinct from s 
and such that t^ £ s^^ for i - 1, ..., n, and denote by B the set of 
all points of 3 through which pass at least one supporting hyperplane 
whose normal has all components positive. Then every point of B is 
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admissible and every admissible point of S is a limit of points in B. 

It is a simple by-product of this theorem that every pure strategy which 
achieves the value of a zero-sum two-person game against all opposing 
optimal mixed strategies appears with positive probability in some optimal 
mixed strategy. 


H. W. K. 
A. W. T. 




A CERTAIN ZERO-SUM TWO-PERSON GAME EQUIVALENT TO 
THE OPTIMAL ASSIGNMENT PROBLEM 1 

John von Neumann 


The optimal assignment problem Is as follows: given n persons 
and n jobs, and a set of real numbers a^, each representing the value 
of the 1 th person In the j th job, what assignments of persons to jobs 
will yield maximum total value? A solution can be expressed as a permuta¬ 
tion of n objects, or, equivalently, as an n x n permutation matrix. 

(Such a matrix can be expressed by J D , where <$. • is the Kronecker 
P i r i 1 J 

symbol and i is the image of i under permutation P.) The value 

of a particular assignment (i.e., permutation) P will be V a With- 

out further investigation, a direct solution of the problem ' appears 

to require n! steps, -- the testing of each permutation to find the 

optimal permutations giving the maximum a v . 

± i i r 

We observe that the solution is ' invariant under the matrix 


transformation a^j —•> a ij . + 
constants. It is clear that 


j' 

+ 


where and Vj are any sets of 

^•v. will be added to each assign- 
J J 


ment value, and that thus the order of values, particularly the maxima. 


will be preserved. This enables us to transform a given assignment problem 
with possibly negative a 1 j to an equivalent one with strictly positive 
a ij> ky adding large enough positive u.^ and Vj. 

We shall now construct a certain related 2-person game and we 
shall show that the extreme optimal strategies can be expressed in terms of 
the optimal permutation matrices in the assignment problem. (The game 
matrix for this game will be 2n x n . Prom this it is not difficult to 
infer how many steps are needed to get significant approximate solutions 
with the method of G- W. Brown and J. von Neumann. [Cf.: "Contributions 
to the Theory of Games," Annals of Mathematics Studies, No. 24, Princeton 
University Press, 1950 -- pp. 75-79, especially j 5-] It turns out that 
this number is a moderate power of n, i.e., considerably smaller then the 
"obvious" estimate ni mentioned earlier.) 


1 Editors' Note: This is a transcript, prepared under Office of Naval 
Research sponsorship by Hartley Rogers, Jr., of a seminar talk given by 
Professor von Neumann at Princeton University, October 26 , 1951• 
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VON NEUMANN 


We first construct a simple preliminary game, the 1- dimensional 
game: We may think of the game as played with a set of n cells or boxes 
indexed i « 1, ..., n. 

Move 1: Player I 'hides* in a cell. 

Move 2: Player II, ignorant of I's choice, attempts to 

•find' player I by similarly choosing a cell. 

This is a play. The payoff is determined by a set of 
(positive). If player I Is 'found' in cell i, he pays player II the 
amount otherwise he pays 0. 

What are the optimal strategies for I? Let his strategy be to 
choose cell I with probability xThen player II will obtain expected 
payoff d.jX.^ by choosing i. Hence he will choose a cell i for which 
<jX^ is maximum. The value for him will thus be max (d-.jX^) . 

Now let x = (x^) be optimal for I. Assume that an 
cLjXj < max . Choose £ > 0 such that dj (xj + 2) « max (d.^) . 

Define 


Xj + £ for I = j 
x ± otherwise 


Then max (<t,xi) = max (d.x,), 

I ii ± li 


and 25 i 

xj 


Xj.' " 


1 + £ 


x ± + £ = 1 + £. Hence the 


can be used as probabilities, and 

max (^x|) 

max (d,x]') = —-< max (d.x.) , 

i 11 1 + £ 1 11 

i.e., x = (x^ was not optimal. Thus necessarily all djXj = max (dj^), 

i.e., oC 1 x 1 - ... - * n x n - A. Now x ± - 1 implies A = l/^i 5^ > 

and, of course, x, - M- . The value of the game (for II) is clearly A. 

1 i 

We now introduce the game in which our particular interest lies. 

We call it the 2- dimensional game; it is a generalization of the 1-dimen¬ 
sional game as follows: 

The cells are doubly Indexed from 1 to n. (They may be thought 
of as fields in an n x n matrix.) 

Move 1 t Player I hides as before. 

Move 2: Player II now attempts to 'find' I by guessing 

either of the indices of the cell in which player 
I has hidden. 

He must state which index he is guessing. (I.e., II attempts to pick the 
row, or the column, of I.) Player I, if so 'found' in cell i,j pays to 
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II the amount e^., where the oty are a given set of positive numbers; 
otherwise he pays o. 

p 

Thus player I has n pure strategies and player II has 2n. 
We now discuss optimal strategies for player I. Let his mixed 


strategy be x 


( x ij)’ x ij 


1, where each x^. represents the 


probability of his hiding in cell i, j. Then player II's pure strategies 


will give a return of 


* L ij x ij 


for row choice i, or x^j 


for column choice j. As in the 1 -dimensional game, he can now simply play 
pure strategies giving the maximum such return. Player I will try to 
choose x minimising this return. Thus the value of the game (for II) 
will be: 


Min 

x 


Max 

iSj 


4 . ( *i’ j X I’ j * X lj') 


The characterization of I's strategies is not quite as easy as before. The 
simple direct compensatory adjustment of the 1-oimensional game cannot be 
made. 

For further progress, we obtain certain results on the geometry 
of convex bodies. 

We define: 


o 

R = Set of all vectors z = (z^.) (in n dimensions), 
such that 


Z lj ^ °’ Z ij “ 1 ’ Z ij ~ 1 ’ 

S = Set of all vectors z « (z^.) (in n 2 dimensions), 
such that 


z lj 1 0 ’ z i j i 1 ’ z i j i 1 ‘ 

2 

T = Set of all vectors z = ( z ij) (In n dimen¬ 
sions) , such that z i j - <f p for some permutation P 
of the integers 1, ..., n* (T thus consists of the 
n x n permutation matrices.) 


We prove two lemmas: 

LEMMA l . S = Set of all z such that z £ some 
w G R. 


PROOF. S 2 this set is immediate. 
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' S C this set is shown as follows: For any z G S let N(z) be 

the number of all i with 2j z^j £ 1 plus the number of all j with 
2J i Zjj £ 1. Clearly N(z) - o, l, 2, ... and R is the set of those 
z G S for which N(z) - 0. 

Now consider a z G S. If z $ R, then there is either 
2j z 1 j < 1 for some i, or z^j < 1 for some j. However, all 

z ij £ a11 Si 2 ± j 1 1# and S-^SjZjj) - 2j(2i z ij^* Hence 

2i z ±i < i for some i implies 2j_ z^j < i for some j, and con¬ 
versely. Therefore both 2j z^j < 1 for some i, say i = i', and 
2 ± z ±3 < 1 for some j, say j - j'. Choose 



Then £ > o. Define 

z , j - z vy + 6 for 1 - 1 ’ ’ J - V 

^ otherwise 

Then z' = (z• ^j) G S, also always z ij - z'^j , i.e., z £ z r ; ana 
either 2 j z£ tJ . * 1 or 2* z i«j = 1 * Hence N(z) > N(z')- 

Iterating this process gives a sequence z<z' <z’’<... in 
S with N(z) > N(z') > N(z' 1 ) > ..., which therefore must terminate. It 
can only terminate with a z^ G R. Hence w « z^ has all desired 
properties. 


LEMMA. 2. R = Convex of T. 

(This theorem is due to G. Birkhoff, Rev. Univ. Nac. Tacuman, 
.Series A, Vol. 5 [1946], pp. 147-148. Cf. also G- Birkhoff, ’’Lattice 
Theory,” Revised Edition, Amer. Math. Soc. Coll. Series, Vol. 25 [1948], 
example 4* on p. 266. The proof that follows is more direct than 
Birkhoff’s.) 

PROOF. R is clearly convex. R oT is immediate. Hence 
R 2 Convex T. 

R C Convey T is demonstrated, if it is established, that all 
extreme points of the convex R belong to T. Actually they form pre¬ 
cisely the set T. 

That every point of T is an extreme point of R is clear: 

A z G T belongs to R, and if it were not extreme, then z = 
tz* + (1 - t)z' * with z*, z* ’ G R; z' ^ z* '; 0< t< 1. Choose 
z ij ^ z iy 3ay z ij ^ z i^- Then z ij • tz£j + (1 - t)zjj, hence 
z£j < z^j < zj^. Now either z^j » o, implying zjj < 0, or z^ = 1, 
implying zJ \ > 1 — and both are impossible. 
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There remains, therefore, only this: To prove that every extreme 
point of R belongs to T. This is shown as follows: 

For a z G R call a pair i, j inner , if z ± j ^0,1. Clearly 
zGT (for a z G R) means that all z^. = o, i, i.e., that no i,j is 
inner. Hence z ( T means that inner i,j exist. 

If a line i (or a column j) contains at most one inner 


element 


then z tJ -.1 - z lj( 


(°r = 1 - Xj, z v £ ia 

Zj . > 0, therefore z* * «* 0, 


necessarily - 1, o, -1, -2, ... . Since z^. > o, therefore z^j *0, 1, 

1. e., i,j is not inner either. In other words: If i,j is inner, then 
there exists an inner i,j' (i',j) with j' ^ j (i* ^ i). 

Now consider a z G R, such that z G T. Let i,j be inner. 
Choose j' ^ j such that i,j' Is inner, then i' ^ i such that i',j' 

Is Inner, then j• • ^ j 1 such that 1', j'' is inner, then i 1 ' ^ i* such 
that i ,, ,j'' Is inner, etc. In this way two sequences i, i', i'», ... 
and j, j', j• 1 , ... arise, such that i^,j^ is inner, i(m)^j(m+1) 
la inner, and l (m) / i (m+1) , j (m) jl j (ln+1) (all this for all m » 0, 1, 

2, ... ). Hence 1^ = or must occur sometime for 

p ^ q. Choose such a pair with p < q, and with q as small as possible, 
and with p (for this q) as large as possible. Hence i^, i^ p+1 ^, ..., 
i (q-‘l), j^(q) are pairwise different, also j^, j^ p+1 ^, ..., 
are pairwise different, with the possible exception of i^ = 1^ or 
j(p) = j(Q) ( or both). For j^ p ' = define i = 1^, j = 

■?(p) (= 1 = i = i*(P +1 ).i = i 


5 Kp > ( 
<(q-D 


q; (or both). For y y) = y 
(q) ), I-. = i (p+1) , j, = j (p+1) , 


define i = 1 V1 ", 


For ft , hence nec 

i 0 = i (p) (- i" q) ), j 0 = j (q) . It - i 


hence necessarily 

hi, -i (p+1) . j. 


i_ _ , = V 

q ' p ‘l<p> = 


J q-p-i 

, define 


i"* Jq_ p _, = I 5 ' 0 - ThUS 

J 0 * Ji* •••» ^3~i (s — q p, 

following properties: i , i-, 


Thus two sequences i , 1., 


also define j = j ) arise, with the 
..., i . are pairwise different, also 


are pairwise different, i t ,j t is inner, i t ,j t+1 I s 


is inner (all this for t = 0, l, 

(O Zj .,Zj ., •• • t 


I.e., the quantities 


\ 1 J 1 * •? 9 

1 0 J 0 i 1 J 1 X S-1 J S-1 

(2) Z^ j , Z^ .,..., Z^ ,• (jg = j Q ) 

■ L 0 J 1 1 J 2 X S-1 J S 

are all > o, < l. 

Now let £ be the minimum of the quantities in the lines ( 1 ), 
(2). Then £> 0. Define z’ = (zjj) and z ,f = (zjj) as follows: 


z ij (z iP 


= z ±j + £ (z ±J - £) for the i,j of line (i) 
= z i; j - t (z ±J . + €) for the i, j of line (2) 
= z, { otherwise 


Then z 1 G R and z 1 1 G R are readily verified. Also clearly z 1 / z • 1 


and z ® j z’ + ^ z 
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Hence z is not an extreme point in R, q.e.d. 


We now return to the 2- dimensional game and a characterization of 
player I's optimal strategies. Let x = (Xjj) be 811 optimal strategy and 
let A be the value of the game (for player II). We define 






< z ij> 


Clearly all wj ^ A and all A, i.e., all 

V j Zj_j < 1 and all ^ < 1 . Hence z = (z^.) belongs to S. 

Now Lemma i implies the existence of a w - (w^.) belonging to 
R, with z ^ w. Form 


■ij 


<v 


Then all 83 A w ij 88 A > and a11 ^ij^ij = A ~*i w ij = A > 


hence ta i ( j., ^ ^j.^j 

x lj 1 u ij' Hence ^lj x lj £ - 


,) = A. 


Also z 1 j < hence 


J lj‘ 
V ij = 9u ij 


ij U lj' 9 = -ij U lj < 1 


Put 


Thon -ij v ij 


^ij x ij = 1 * i,e *' the v ± . can be used as 


probabilities, like the x. .. Also Max ( ,jV^,j> ^l jf v ij') = 

i t J 

©A. If © < 1 , then this contradicts the optimality of x = ( x -j_j) • Hence 
e = 1 , 

x ij = u ij' 


i.e., lij x ij “ Since ^ u ±j» 

Hence z = w £ R. 


i.e., z^-w^. 


Now Lemma 2 implies that z 
points of T. I.e., 


this implies 
is the oenter of gravity of certain 


t z 

v 


The t 


z = 2 

^ y 

0 may be omitted, i.e., t 


t y > ° • 


2 t - 1 

v 

> 0 may be assumed. Form 


z ij 


*i.i x i.i 


< x Ij> 


Then the optimality of x implies that one of all x v . 
for a suitable permutation P v . Hence 


Also * 1J = <P 

1 P »j 


y? _ 

X ij «*-. 


ij 


P V 

i P ,i 


In other words: All optimal strategies are centers of gravity of 
optimal strategies of the special form 
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(*) 




A rf 

i P ,j 


(P a permutation) 


Consider, therefore, the strategies of the form (*). For such a 
strategy all d ±j x ±j “ A and all X± ^ij^ij = A - Hence 


Max 

i'J 




Hence the optimal ones among these strategies are those that give the 
minimum A. 

Now, since the x. . are probabilities, V, . x,. = 1, i.e., 

v* A - 1 “I J-J J-J 

2^ j - =1, i.e., A = l/2i *- • Hence the minimum A corresponds 

i i^ ^ l i i^ 

to ’ the maximum X± oC- • ' I.e., precisely those permutations P 

give the optimal strategies^'^ in question, for which — assumes 


its maximum value. 

To sum up: 


i,i r 


THEOREM. The extreme optimal strategies (i.e., 
those, of which all others are centers of gravity) of 
the 2- dimensional game are precisely the following ones: 
Consider those permutations P which maximize 


X 


i *" 




For each P of this class form the strategy x = (x^j) 
according to (*) above.- 


Note, that this means that player I plays only those cells where 
the permutation matrix (of P) has a 1. (Here line guesses (i) and 
column guesses (j) correspond to each other equivalently under the rela- 

p 

tion j = i .) His play among these cells is then determined by the 


1- dimensional game. - 

The condition expressed in the above Theorem for P is exactly 
the optimal assignment problem with a^ = 1 /*^y where the a^. are the 
elements of the assignment matrix (which, we saw, could be considered as 
all positive). 

Several further remarks can be made. 

1) A transformation of a i j —•> a ij + u i + v j ln 
assignment matrix leaves the solution unchanged, and hence the game will 
be invariant (in its P's) under the corresponding 
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> 1 + *ij (u i♦ v j 5 ' 

That the game should he so invariant is not at all clear initially from the 
game Itself. (Note, this is not complete invariance. The 1 - dimensional 
solutions for a particular P may change, though the P remains the 
same.) 

2) Various extensions of the optimum assignment problem are 
possible and can be settled in essentially the same manner. Thus one can 
specify pertain many-to-many assignment patterns between persons and jobs, 
and th#like. 

In addition, certain formal generalizations of the game are 
possible — to various k-dimensional forms with k - 3, 4, ... . These 
seem to be interesting, but present serious difficulties. 


J. von Neumann 


The Institute for Advanced Study 



TWO VARIANTS OF POKER 1 

0 

D. B* Gillies, J. P. Mayberry, ana J. von Neumann 
INTRODUCTION 

Although the minimax theorem for zero-sum two-person games asserts 
that there always exist good strategies for such games, their calculation 
may be a most formidable problem. Methods for simplifying this problem are 
certainly necessary if the complex games which simulate economic situations 
are to be attacked. In "The Theory of Games and Economic Behavior” (here¬ 
after designated as [1], in accordance with the bibliography at the end of 
this paper) several idealizations of actual games of Poker are discussed, 
complete solutions are given to two of them, and some information is given 
about the solutions to others. This paper supplements that discussion 
with the solutions of two of the other variants mentioned there. Part I 
deals with the discrete case of sections 19.4-19.6 of [1]’while Part II 
completes the discussion of the continuous variant of section 19-13* 


PART I 

$ 1 . DESCRIPTION OF THE GAME 

We deal with the game treated in [1], sections l9-^-19*6, pp. 190- 
196. The players v and 2 each obtain by a chance device a "hand," (i.e., 
an integer from among 1 , 2 , ..., S); for either player, each of these 
hands is to have equal probability, independently of the opponent's hand. 
Then each player, being Informed of his own hand but not of his opponent's, 
elects to bet either the amount a (the high bet) or the amount b (the 
low bet), where a y b y 0. If both bet a [both bet b], the holder of 
the higher hand (larger integer) receives the amount a [the amount b] 


Editors' Note: This is a supplement to THE THEORY OF GAMES AND ECONOMIC 
BEHAVIOR, pp. 186-219 (as promised in a footnote on page 196 ). It was pre¬ 
pared under Office of Naval Research sponsorship by D. Gillies (Part II) 
and J. P. Mayberry (Part I) from notes of Professor von Neumann, with his 
advice and collaboration. 
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from his opponent} (if the hands are equal, no payment is made). If one has 
bet high and the other low, the latter may choose either to "see," or to 
"pass." If he chooses to see, payment is made as if both had bet high 
originally; if he chooses to pass, he must forfeit the sum b, regardless 
of the hands held. 

For any s with s = 1, ..., S the player has three strategic 
choices, described by a numerical index i s - 1, 2 , 5 ; i s = 1 meaning a 
"high" bid; i s - 2 meaning a "low" bid with subsequent "seeing" (if the 
occasion arises); i g » 3 meaning a "loV" bid with subsequent "passing" 

(if the occasion arises). Thus the (pure) strategy is a specification of 
such an index i s for every s = 1 , ..., S — i.e., of the sequence 

l i» • v 

This applies to both players. Accordingly we shall denote the 
above strategy by ^(ij, ..., lg) for player 1 , and a corresponding one 
by ig) for player 2. 

$ 2. DEFINITIONS 

Mixed strategies are Introduced as In [1], pp. 192-1 9 ^- I.e., 

Instead of introducing a separate probability ^ fyi for 

player 1's [player 2's] using the pure strategy • • • lg) 

••• suffices to use the probabilities [it®] for 

player 1 's [player 2's] choosing i s = i when his hand is s — and, of 
course, doing this for each s * 1, ..., S. These probability-systems are 
then subject to the conditions />® > 0 [<r® > 0 ] for all s,i, and 
/*® - 1 [ - 1 ) for all s. 

If players 1 and 2 use the mixed strategies p « (/>®) and 

(<r®), then the expected payoff of the game is the K(P\r) of formula 
(19:6) in [1], p. 195 (there designated K(7 ] , ..., ? S |ir, ..., <r S )) . 
Clearly (cf. also (19:7) in [1], p. 195) 

(2.1) Wlr) = £X 8>1 

where ¥® * ¥®(>*) is the expected payoff for player 1 of his strategy p 
against player 2's actual hand s and actual choice i - i. Equations 
(19:9:a) * (19:9:c) in [1], p.196 — or, alternatively, a common sense 
evaluation of the meaning of the jr® — state 

(2.2.a) jf? - £ j St< 8 (-a^ - a r\ - b#*> - bf® ♦ X t>8 (a^ + af»| - b f\) J , 

(2.2.b) i j - vj> ♦ X t>8 (a^ ♦ b f\ + b Pp | , 
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<2.2.0 t\ - g j 2t<s (b ^ - b 4 ' **$> + b '® + St>s (b ^ + b 'I ♦ ) • 

Since the game is symmetric, a strategy f> is good if and only 
if it is optimal against itself (cf. [ 1 ], top of p. 195 ), i.e., if 

( 2 . 5 ) KC/’Icr) assumes its ^minimum at <r = f . 

In view of (2.1), and of the domain of variability of the <r|, ( 2 . 3 ) can 
also be stated like this (cf. also (19:A) in [ 1 ], p. 196 ): 

( 2 . 1 *) tl > Xj Implies = 0 (for all s,l,j) • 

Because of the symmetry K(/ , ,/>) = 0 , hence ( 2 . 3 ) means that 

min K(/°|cr) = 0. Again, because of K(f\f) * 0, this is equivalent to 

K(/*|<r) > 0 for all <r. Owing to (2.1), this can also be stated like this: 

( 2 . 5 ) £ s I 3 ,* > ° (for all 1,, .... i s ) . 

{ 3• PLAN OF ATTACK 

In (h) we show that there exist strategies f> = (/>®) where all 
/>| = 0. We direct our attention to their discovery. 

In (5) we establish a characterization for good strategies among 
the ones to which we are now limited — where all = 0, I.e., where the 

choice is restricted to i g = 1, 3 • 

In (6) we obtain a rather specialized, but still somewhat re¬ 
dundant, normal form for these strategies, in terms of certain parameters 
P,Q (- 1, ...» S) and ^ - 1,< 1), J|(^0,< 1). 

In (7), (8) this normal form is discussed and specialized further 
until an actual catalogue of all good strategies (as restricted in (4), 
cf. above) Is established in (8). 

In (9) the restriction of (*0 is reconsidered. 

In (10), (11) certain general interpretive conclusions are 

drawn. 

f 1*. PROOF THAT THERE EXIST GOOD STRATEGIES WITH AIL f>\ = 0 

Suppose we have a good strategy f = (f ®), in which some > 0 
Let s # be the largest such s, i.e., > 0 and ■ 0 for a > s . 

By (2. 2 .a), (2.2.b) with s - s*, there results r®* > y®* if ever 
> 0 for s < s* or ever f® > 0 for s > s*. By (2.1*) y®* > y®* 
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Implies = 0, which is not the case. Hence necessarily />| = 0 for 
s < s* — and, since this is the case for s > s # , too (cf. above), 
therefore f® = 0 for s ^ s — and ^® = o for s > s*. Summarizing: 

If > o occurs at all, then it occurs for precisely 

^ * s 

f . one s, say s = s . In this case p 0 = o for 

\ *s a tL 

s < s ; p* = 0 for 3 = 3 ; ^2 = ^3 = 0 (hence 
/>® = 1) for s > s*. 

Next define ^ = (^®) as follows: 


( 4 . 2 ) 


- /*® + /*! for s = s # , i = 1 , 
= o for s = s*, I = 2 , 

= />® otherwise. 


(Note, that f®* - o [cf. (4.1)] implies, that actually p^* = 1 , 

^ 2 *“ ^ 3 * * 0 .) Let this substitution take y® into y®. Now ( 2 . 2 .a) - 
( 2 . 2 .c) give y® ^ y® for all s,i, except for s > s*, 1 = 2 , and in 
this case V®. I.e., for every s and i s there exists a j s , such 

that ?? > y? . Hence the validity of ( 2 . 5 ) for p (i.e., the y) im- 

1 s ” _ 

plies its validity for f (i-e., the ?) — i.e., the goodness of P 

implies that one of /*. Summarizing: 


(4.3) 


If P is a good strategy according to (4.1) (i.e., with 
0 ), then the 7 of ( 5 - 2 ) (which has all /*® = °) 
is also a good strategy. 


Thus the statement in the title of (4) is correct. Accordingly, 
throughout ( 5 ) - ( 8 ), P = (f®) will be assumed to be a strategy with all 
^|=o, and its goodness will be the subject of the Investigation. 


{ 5 • ALGEBRAIC CRITERIA FOR GOOD STRATEGIES 

Consider the criterium of goodness (2.4). Since />® = 0 , it 
need not be applied for i = 2 . Consider now j « 2 . ( 2 . 2 .a), ( 2 . 2 .b) 

show that always y® < y|. Hence the case i = 1 , j =* 2 need not be 
considered. The above also implies y® - J® £ y® - y|. Hence the case 
i * i * 2 is disposed of if the case i = 3, j = 1 is. Thus there 
remain only the cases with i, j ^ 2 , i.e., i = 1 , j = 3 and 1 = 3 , 
i = 1 . These cases state, that y® > y® implies f® - 0, and that 
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y® < r| implies = o, i.e. 

■* - ’• 

Put 

(5 • 1) u s 

= ifn u 3 

- r?) ■ 

Then these conditions become 



r u s > o 

implies 

Pi 

(5.2) « 


l u s < 0 

implies 



Thus the goodness of P is expressed by (5-2). 

Next, (2.2.a), (2.2. c) give 

uS = ^t<3 + Pp + St>3 ( - P\ + iH P \ ) ■ 

Since Pj = 1 this becomes 


(5-3) 

Prom (5-3) 
(5.4) 


- 2t<s cf - 2 t>s cf * (2<s -.) * i) . 


“ 3 *’ - - /■? * /•?*’ - i* 


$ 6. DERIVATION OF THE BASIC STRUCTURAL PROPERTIES 

(5-3) yields u^ > 0, hence by (5-2) p^ = 1 . 

If /> 3 * 1 (for some s = l, ..., S - l), then (5.2) gives 
u s >0, (5«3) gives u s+1 - u s > 0, hence u s+1 > 0, and so by (6.2) 

M =1 * 

Thus s with /° 3 = 1 exist (e.g., s * S), and If s = R is 
the smallest one, then s=R+ 1, S, too, belong to this class. 

Hence they are precisely s = R, R + 1, ...,S: 


( 6 . 1 ) 


{^ = 1 

[ is a s 


occurs precisely for s - R, R + 1, ..., S, where R 
suitable number = 1, ..., S. 


For s = 1, . .., R - 1 /> 3 ^ 1, hence by (5*2) u s < 0. It 

is therefore of interest to determine those s = l, .. ., R - 1 , for which 
u s = o. Let iS be the set of these s. 

Consider an s G / Assume s - 1 ( \f (s ^ 1). Then u 3 ■ 0, 
u 3 * 1 < o (cf. above), hence /> 3-1 * o (by 5-2) and u s - u 3 * 1 > 0, 
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hence /» 8_1 + - sfjj > 0 < b Y (5-4)), i.e., />® > gfp . Hence 

f* + A>° +1 ‘ iiE> °' i-e -' uS+1 - uS > 0 < b Y (5-4)), u s+1 > 0, /* 8+1 - 1 
(by (5.2)). Hence s + 1 ^ R, and since s < R - i, this gives 
s - R - 1 . Thus s € jj implies s - 1 6 j/ if s^R-1 (and s ^ 1) . 

Now let P be the largest number among o, i, ..., R - 1, such 
that all s - 1, ..., P belong to j/. Then, according to the above, j/ 
consists of the s * 1, .. , P, and possibly s = R - 1 . If P » R - 1, 

then the addendum s * R - 1 is not needed; if P - R - 2, then the 

addendum s - R - 1 would require P = R - 1 . I.e., this addendum can 

only occur for P / R - 2, R - 1 . 

Assume P / 0 and R ^ 1 , 2. Then u] - 0, u^ < 0, hence 
u ? " U 1 i °» i,e -' f*\ + ~ a+li 0 (by • 4)), hence “/», < gfp • Also 

~2_ o, hence - gyp (1 + £) with - 1 ( 8 < 1 • Next, let 

s, s + 1 = 1, —, P. Then u s = u s+1 = 0, u s+1 - u s = o, I.e., 

f* + /»f +1 - “ 0 < b Y 5-4)), hence /> 8+1 = gfp - />*. Summarizing: 

If P ^ 0 and R ^ 1, 2, then there exists an £ 

(6.2) with - 1 < t < 1, such that for 8-1, ..., P 

- * /*? = iTE (1 1 £) for 3 (even} * 

Next, assume P ^ 0 and R = 1 , 2. This means P - 1, R = 2. 

If f 1 < ifs » then > 0 Elves - gyp 0 + 6) with - i < £ < i, 
i.e., (6.2) still applies. If f 3 > ggp , we redefine P : P = o, and 
view s = 1 - R - 1 as the addendum referred to above. Thus this addendum, 
s « R - 1, has at any rate p ® . Also />® < 1, hence * 1 - 

Ijh *1 wlth 0 < 1 < 1 • 

Finally, for P - o (6.2) is vacuous. 

Summarizing: 

For s - 1, ..., R - 1 necessarily u s < 0. Let J 

t ** a 

be the set of all s - 1, ..., R - 1 with u - 0. 

The elements of J can be represented in this way: 

(a) All s - 1, ..., P. 

(b) Possibly s * R - 1. 

P is a certain number =0, 1, ..., R - 1. If (b) oc¬ 
curs, then P ^ R - 2, R - 1, except that P - l, 

R - 2 is not excluded. The />®, for s G J are rep¬ 
resented as follows: 

(a) There exists a fixed £ with - 1 < £ ^ i, 
such that for s - 1, ..., P * 
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P* " ITE (1 1 £) for 3 {even] ' 

There exists a fixed Y| with o < l| < 1, 
such that for s =. R - 1 (if the case (b) 
arises) 

. a-b >. 

P\ “ 1 - I7E 1 * 

The case (b) can be made to arise with certainty, by doing this: 
If case (b) does not arise, replace R by R + 1, and say that (b) has 
arisen with tj = o. 

The set of all s = 1, ..., R - 1 not in consists now pre¬ 
cisely of the s-P+l, .. ., R - 2 . Put Q-R-P-2 = o, 1 , ..., 
then these are the a - P + 1, ..., P + Q. For these (5-2) gives (this was 
used earlier) = o. I.e.: 

(6.4) For s - P + 1, • • •, P + Q always f>* = 0 . 

Combining (6.i), the revised form of (6.3), the definition of Q, 
and (6.4) we can summarize as follows: 


(b) 

(6.3) < 


The basic parameters of a solution are these: P, Q, £, 
They are subject to these conditions: 

P, Q - 0, 1, 2, ... } S £ P + Q + 1 ; 

-!<£<' 5 0 < »l < 1 

P/0, Q - 0 imply 7 | = 0 . 


(6.5) 


They determine the p" 


< 


r 


(1 - s) 


'U 




a+b 


1 a ’ b * 

I+E 1 


(s = 1, ..., S) in this way: 

for 3 {even} ’ 311(1 8 = 1 » • • ■ ’ 

for s - P + 1, ..., P + Q , 

for s - P + Q + 1 , 

for s * P + Q + 2 , ...,S. 


P / 


Note, that now consists of the s * 1, ..., P, and, if 
T| ^ 0, also s * P + Q + 1 . 
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j 7. ALGEBRAIC CRITERIA FOR GOOD STRATEGIES (CONTINUED) 

We can now determine all good strategies (in the sense of the re¬ 
mark at the end of (4)), by applying (5*2) to (6.5). We will also check 
that u 3 ~ 0 for all s G */, in the sense of the definition of 

These, conditions must hold for all s * 1, S. We deal with 

these in three segments: 

s *= 1, ..., P: These belong to J\ hence we must require 
u 1 « ... = u 1 * - 0. This satisfies (5*2). By (5-*0 u s+1 - u s * 0 for 
s = 1, P - 1, i.e., u 1 = ... = u P automatically. Hence the only 

condition that we need to state is 

(7-1) u 1 = o if p / o . 

s = P + 1, .... P + Q: (5-2) requires u s < 0 for s = P + 1, 

.... P + Q. By (5-*0 u a+1 - u s < o for 3 = P (if“ P / 0), P + 1, ..., 

P + Q - 1, hence i/ £ u P+1 (if* P ^ 0) and u P+1 £ ... £ u P+Q . The 

above requirement is therefore vacuous, if Q = 0 ; it follows from u P = o, 

1 P 

which is a consequence of (7*1) (and of u = ... = u , cf. above), if 
P 7 * 0 , Q / 0 ; it would follow from u P+1 < 0, i.e., u 1 ^ 0, if 
P » 0, Q ^ 0. Hence the only condition that we need to state is 

(7-2) u 1 < ° if P = 0 , Q ^ 0 . 

s « P + Q + 1, ..., S: s = P + Q + 1 belongs to J if tj ^ 0, 

hence we must require u 3 = o in this case. This satisfies (5-2). If 

T| « 0, then (5*2) requires u s £ ° in this case. I.e., 

(7-3) u P+ ^ +1 >0 with = if T| ^ o . 

(5.2) requires u s \ o for s - P + Q + 2, ..., S. By (5*^) u s+1 - u s > 0 
for s =* P + Q+ 1, ..., S - 1, i.e., u P+1 < ... < u^. Hence the above 
condition is automatically satisfied owing to (7*3). 

Thus (7*1) - (7*3) are a complete characterization for good 
strategies. 

Now (5-3) gives for P {^van} s 

“-ife< p - 1 - - 1 + 

- (S - P - Q - 1) + ^ (23 - 1) 

“-S^ S+ * + S?E P *i& l e’ + i^’ 
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with these additional observations: For P - Q « o this case is imma¬ 
terial. For P - o, Q / o, the - (P - 1 - {£)) -term in the first 
form of the right hand side above should be omitted. This is best achieved 
by putting £ = - 1 in this case. 

Next, (5-3) gives for P (even! ! 

u P+ft+1 = STE (p + 

-(S-P-Q-1)+ j~- (2(3 - P - ft - 1) + 1) 

+ + STb ( o) + S7b • 

I 

Hence (7-1), (7-2) can be stated like this: 


(7-M 


" P<^3 -fl^ft-l (§) 

for P {°^J i With = if P ^ 0; with £ = - 1 if P = 0, 
w Q ^ 0; with the condition omitted If P • Q = 0. 


(7-3) can be stated like this: 

.p > ^ s - ft - | - i 

for p feven] * with = lf 1 * 0 • 
f 8. CATALOGUE OP GOOD STRATEGIES 


(7-*0, (7-5) characterize the good strategies. It is convenient 
to restate them with the aid of the quantity 


( 8 . 1 ) 


L = P + Q 


in place of P. The statements of ( 6 . 5 ) concerning P,ft now become 
(8.2) L - 0, 1, .... S - 1 ; ft = 0, 1, .... L . 


(7.*0, (7-5) become: 


(8.3) 


L< Sjfe S - | (ft + (g)) - *=& 1) 

4 for L - ft [°^ n ] ; with - lf L / ft 5 with £ = - 1 
L - Q ^ 0 ; with the condition omitted if L « Q - 0 . 


if 
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L > Sjfe 3 + | (Q - {£}) - 1 
for L - Q i wlth - if ? / 0 • 

It is now convenient to distinguish four cases: 

I: L ~ 0 — i.e., P * Q * 0: 

( 8 . 3 ) is omitted, (8.4) becomes o > S - l, i.e., 

(8-5) 3 <lV 

Thus ( 8 . 5 ) characterizes this case. 

II: L = Q / 0 — i.e., P = 0, Q ^ 0: 

( 8 . 3 ) becomes 

L < ^ 3 -1 (L - 1} -^ 1» 

i.e. 

L / a-b rj . b a-b y. 

< ilH 3 + 57b ’ Sib ’l • 

(8.4) becomes 

L > 3 + s L - 1 * 

i.e. 

L l 3 - ' 

with * if i| j* 0 . Hence necessarily 

L i tlE 3 + SIE ' 

L l 3 " A ' 

and if these inequalities are fulfilled, then the original ones are, too, 
with i| - 0. 

Thus (8.6) (for an L - 1, 2, ... ) characterizes this case. 
Note, that if an L according to (8.6) exists at all, it is 
unique. Indeed, the opposite would require that the length of the interval 
of (8.6) be ^ 1 . This means 

flS 3 + S7E 1 (s - s5? ) + 1 ' 

which gives S < . Then the first relation of (8.6) gives L £ 1, 
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hence no solution other than L - 1 exists. 

Note further, that ( 8 . 6 ) necessitates 


a-b 

a+b 


S + 


a+b 


> i 


i.e. 

(8.7) 


2 2 
a / a / a + 2 ab - b 

a-b S b S 2 b(a - b) 


III: L yt Q - 0 — i.e., P ^ 0 , Q 

( 8 . 3 ) becomes: 


3 -1 »i 


for L |even] ' becomes 


- | {$) - ! , 


for L {even! ' Wlth = f0r ^ ^ 0 ' 

The proviso made in ( 6 . 5 ) refers to this case and implies 0 . 

Consequently we have the conditions 


for k {even] 

( 8 . 8 ) 


L = s r s -5 1 ^ 1 > 


L > &=£ S 
£ a a 


I & - * . 


For an odd L the first condition becomes 




while the second one Is then automatically satisfied. For an even L the 
first condition becomes L = ~~ S - ^ fc , i.e. 


(8.9) § i ks -a^ L i S a^ S+ a' 

and the second one is again automatically satisfied. 

Thus (8.8) (for an L =* 1, 3, ... ) or ( 8 . 9 ) (for an 
L * 2, 4, ... ) characterizes this case. 

Note, that if an L according to (8.8) or ( 8 . 9 ) exists at all, it 
is unique, because of < 1 : If ( 8 . 8 ) gives an odd L, ( 8 . 9 ) cannot 
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contain an even L, and ( 8 . 9 ) cannot contain two different even L. 

IV: L^Q^O — i.e., P ^ 0, Q / 0: 

Since ft* 1, 2, therefore Q + 1*} and Q - (^) }> 0. 

Hence ( 8 . 3 ) iaplles L < ^ 3 and (9-*0 Implies L > ^ 3 - 1 . "Hence 

sb a sr a 

(8.10) L = ^ 3 - K , 
where 

( 8 . 11 ) ' a ^S-K=2, 3,...; 0 < K < 1 . 

Clearly (8.11) can be satisfied by a suitable K if and only if S 

i.e. 

(8.12) S > . 

Also, the K of (8.11) is unique, unless S = 3, 4, ..., in which case 

K * 0, 1 will do. In this case, however, (8.8) (with L - 3, 5, ••• ) or 
(8.9) (with L = 2, 4, ... ) can be fulfilled. Hence we can Ignore it. 

Now ( 8 . 3 ) becomes 

K = | (Q + lg}> ♦ 
for L - Q • 

(8.4) becomes 

-1 (Q - tg)) + 1 

for L - Q {°^ n j ; with - if 1} jt 0 . 

It is best to discuss ( 8 . 13 ), (8.14) separately for i| - 0 and 
for T| / 0 . 

H « 0 : ( 8 . 13 ) becomes 

(8.15) Q + (g) = § K 
(8.14) becomes 

(8.16) Q - (8) < f (1 - K) for L - Q {°^ n } . 

i| ft 0 s Here 0 < < 1 , and in view of this ( 8 . 13 ) becomes 





HV' 
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(8.17) 


ft- IS) 


t > S 


< t* 


\ tl TT 8l*b 

> E K - T" 

(8.14) becomes 

( 8 . 18 ) ft - ($) - | (1 - K) for L - ft 1 

The second relation in (8.17) can be transi'orined by adding (8.18) to it. 
This gives 


for L - Q f odd \ . 
^ leven) 


2Q + l > 1 . 


Since Q= 1, 2, ..., this is always true, except when Q= 1, t = - 1 
for L {^ n j . I-e., the second relation in (8.17) can be replaced by 
forbidding this. 

Hence all these cases (expressed by ( 8 . 15 ), ( 8.1 6) for *| = 0 
and by ( 8 . 17 ), ( 8 . 18 ) for t) ^ 0 ) can be summarized as follows: 


Either ft + (£) = § K , 

ft - CgJ < t (1 

- K) , 

or ft + (°) < | K , 

Q - tgi = f 0 

- K) , 

for L - (even) • For 

the second alternative. 

‘ L ID 

is excluded. 



Q - 1, 


The first alternative, with L - Q odd, requires that j| K be 
an integer, and of opposite parity to L- Then Q = j| K, and 
Q - fc < (1 - K) in addition. This is possible if and oniy if 

Q - 1 < f ( 1 - K) , § K - 1 < § ( 1 - K) , 

a rr / 1 /fit , . \ a*t*b rr / a*^b 

H K S2 ( U +1)= -“2b' K i~2i’ 


I.e.: This occurs when 


(8.20) ^ K is an integer, of opposite parity to L, and K< . 


The second alternative, with L - Q even, requires that 
(1 - K) be an integer, and of the same parity as L. The exclusion made 
there is irrelevant, since the conditions that apply to this case cannot 
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force a choice fc - - 1 . Then ft - jj (1 - K), and ft - £ < | K in 
addition. This is possible if and only if 


Q-1<§K, | (1 - K) - 1 < | K , 

a rr \ 1 / a < \ a-b »»> \ a—b 

H K> 2 ( F“ 1) “Tb > K > “2a * 


I.e.: This occurs when 
a 


( 8 . 21 ) 


£ (1 - K) is an integer, of the same parity as L, and 

K \ s^b 
K ' 2a • 


Assume, finally, that both of these cases do not take place, i.e., 
that the first alternative holds with L - ft even, or the second alterna¬ 
tive with L - ft odd. The excluded case ft » 1, £ = l can only be forced 
by the second alternative in (8.19) when K = 1. This possibility has the 
same consequences as the one considered immediately after (8.12). Hence 
the exclusion of Q = 1, £ = l can be disregarded. 

In view of these remarks, ( 8 . 19 ) now becomes this: 


(8.22) J 


Either ft + £ = ^ K , ft of the same parity as L, ana 
ft<j|(l-K), or Q-E * j (1 - W , ft of opposite 
parity to L, and ft < | K . 


The first alternative means, that the smallest integer of the same 
parity as L, which is > § K - 1, is also < § (1 - K). I.e.: 


(8.33) < 


There exists an integer Q of the same parity as L, which is 
> f K - 1 and < § (1 - K) . 

The second alternative means, that the smallest integer of oppo¬ 
site parity to L, which is > jj (1 - K) - 1, is also < § K. I.e.: 

There exists an integer ft of opposite parity to L, which Is 
< § K and > f ( 1 - K) - 1 . 


(8.24) 


Adding 1 to the integer referred to in (8.24), this assumes the following, 
equivalent, form: 
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f There exists an Integer Q + 1 of the same parity as L, which 
(8,25) [is < §K + 1 and £ § (i - K) . 

Now let Q* be the unique integer of the parity of L, which is 

^ jK - 1 and < K + 1 . Then ( 23 ) is solved by Q if and only if this 

is * Q*, Q* + 2 , Q* + 4, ... and < £ (1 - K) 5 and ( 25 ) is solved by 

Q + 1 if and only if this is = Q*, Q - 2 , Q* -4, ... and ^ § (1 - K). 

The former is possible when Q < ^ (l - K) $ the latter is possible when 

Q* 0 - »• 

One more thing remains to be determined: Whether the Q, accord¬ 
ing to ( 8 . 19 ) fulfills the requirements of ( 8 . 2 ) and Q ^ L, i.e., whether 
Q < L. If this were not the case, there would be Q > L in (8.19)* Now 
by (8.4) 


L^S|ks + | ( Q-0-1 , 

hence Q > L gives 

s + | (Q - 1) - 1 , 


and so 


Adding the two relations of either alternative of (8.19) together, gives 

aQ + f|} < | , 

i.e. 

2Q - 1 < | » ft < • 

Hence 

o 

« ✓ a+b . a+b _ (a+b) 

3 S “IE “ '2F(a-h • 

In other words: 


( 8 . 26 ) 


(a+b) ^ 
> 2bTa-b7 


suffices to guarantee Q< L — i.e., the requirements of ( 8 . 2 ) and Q ^ L. 
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r 


Note, that ( 8 . 26 ) implies ( 8 . 12 ). 
j 9. REMARKS CONCERNING GOOD STRATEGIES WHERE f\ p 0 OCCURS 

Consider a good strategy p * (P^) where p 2 / 0 occurs. Apply 

(4.1) - (4.3), and form, in particular, the good strategy (p^) re¬ 
ferred to there. For this always p* m °> (5) - (8) apply to it. The 

quantities and concepts that were introduced in ( 5 ) - (8) should therefore 
be understood in the balance of this section as referring to p (and not 
to p ). 

Consider the s of (U. 1 ) . According to the remark immediately 
following (4.2), 1. Hence by ( 6 . 5 ) 

(9-1) s* > P + Q + 1 , with > for Tj ^ 0 . 

It is easily seen, that the other inferences that can be drawn from (4.3) 
(with (4.2)) are automatically satisfied owing to (9.1). 

For any s* satisfying (9-1), P = (f?) can be derived from 

— Q O* A 

P * (^J) according to (4.2). Here p 2 can be chosen freely, subject 
only to 

(9.2) ° < /»! < p , 

all other are then determined. There remains the task to establish, 

which of the strategies P that obtain in this manner are good. This will 
not be undertaken here. 


$10. CONCLUDING REMARKS 


From the general existence proof (i-e., the minimax theorem, 
cf. the reference at the beginning of the introduction.) we know that good 
strategies must always exist -- i.e., for all values of a,b (a > b > 0 ) 
and of S(« 1, 2 , ... ). 

Our present results, as formulated in (8) (together with (4.1) - 

(4.3), cf. (9) above), do not go quite as far in all cases, but what con¬ 
cerns us here, is the additional information that they give for most cases. 

To be specific: 

Put k -- hence 0 < tj < 1 . £ 

Case I (P * Q - 0 ) takes care precisely of the S < 

(cf*. ( 8 . 5 ))* Case II (P * 0 , Q p 0) takes care of certain ~ 




TWO VARIANTS OF POKER 


29 


(cf. (8.7)), possessing certain special arithmetical properties (cf. (8.6)). 
Case III (i.e., P f o, Q - o) takes care of certain S (cf. (8.8), 

( 8 . 9 )) that form an unbounded set, which has an asymptotic density that is 
in general <1 (cf. below). Case IV takes care of certain S, that 
comprise all the S above a certain limit, namely all those 


S > 


2u>( 1 -id) 


(cf. ( 8 . 26 )). 

Thus Cases III and TV represent the "general" solution, and IV 
usually more than III. To elaborate this further, note that IV comprises 
all the S above a certain size, while III as a rule does not. In this 
respect the two following observations are relevant: 

Regarding III: If to is Irrational, then the set of (8.8) is 
empty, and the set of ( 8 . 9 ) has the asymptotic density w. If u> Is 
rational, with the (Irreducible) denominator n (= 2, 3 , — ), then the 
set of (8.8) has the asymptotic density , and the set of ( 8 . 9 ) has the 
asymptotic density <0 + • Hence Case III has the total asymptotic 

density w or ^ , respectively. This is <1, unless u> is 

(rational and) = (n = 2, 3 , ••• )• 

Regarding IV: The actual value of S for Poker is 2 , 598,960 
~ 2.6 x 10^ (cf. (1)). Thi3 lies outside the domain of Case I (I.e., it 


is > ~£j) unless w > 1 - 3.9 x 10 “ 

Case II (I.e., it Is > g-fyj^y ) unless w> 1 _ 7.8 x 10 “' or 
<*) < 1.9 x IQ-?. I.e., if we disregard altogether implausible and extreme 

values of - Case IV Is valid, and Cases I, II are not. 

a* 


,-7 


it lies outside the domain of 

,-7 


<{ 11 . CONCLUDING REMARKS (CONTINUED) 


The observations of ( 10 ) justify our limiting our Interpretations 
to the Cases III and IV of (8), with a special emphasis on Case IV. 

In both Cases III and IV values p® ^ 0 , 1 occur (for 
i - 1 , ..., P there is {>* = (1 - *), cf. ( 6 . 5 ), remembering w = | ), 

i.e., these are truly mixed strategies. Regarding their detailed properties, 
the following things can be said. 

Consider first the asymptotic behavior, i.e., that for S —> « 

— this is/ of course, approximately valid and typical for large S, e.g., 
for the "real" case S ~ 2.6 x 10 ^ (cf. the end of ( 10 )). 

As observed immediately before ( 8 . 26 ), L - P * Q is bounded 
( < ^3 ), and by ( 8 . 8 ), ( 8 . 9 ), ( 8 . 10 ) (1 - ») 3 - L la also bounded. 

Thus (1 - tu) S - P and Q are both bounded, and therefore 
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( 11 . 1 ) I—> 1 -«,§—> 0 . 

Hence the behavior of , for s ~ P + 1, ..., P + Q is 
irrelevant. For s-P + Q+l, ..., S />® = i. For s * 1, ..., P 
alternates between the values (1 - t) (cf. above), i.e., it fluctuates 

by yfj; lei, but its average le • 

Thus the mean behavior converges to the one determined in equa¬ 
tion ( 18 . 21 ) of [1], p. 202 , for a continuum of hanas. This is unaffected 

by the possible Introduction of the p% according to (U) and ( 9 ), since 

* 

this affects only a single s (* s ). The mean referred to above may be 
taken for any s-interval whose length increases asymptotically propor¬ 
tionately to S, as S —■> oo. 

On the other hand, the exact oscillation of the p^ does not 
subside asymptotically, as S —> oo. Indeed, the oscillation of (in 

the domain s = 1 , ..., P, between neighboring values of s) is 
—5 |£| (cf. above), and S —> oo does not imply 6 —■> o. A specific 
inspection of Cases III and IV in ( 8 ) shows, that € Is very sensitively 
determined by the precise arithmetical relationships between u> (i.e., 
a,b) and S, and that it sweeps its entire domain quasi-periodically, no 
matter how large S gets. 

Using a terminology that is familiar from function theory, one 
might say: as S —> «>, the good strategies of the discrete-hand-poker 
converge to those of the continuous-hand-poker In the sense of "weak" con¬ 
vergence only. This phenomenon is therefore heuristically instructive, 
regarding what one should expect more generally, when a "continuous game" 
is investigated in detail In its relationship to the "discrete games" of 
which It might be viewed as a limiting case. 
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PART II 

i 1 . DESCRIPTION OF THE GAME 

The situation to he dealt with is described in "Theory of Games," 
section 19-13 (pp- 209 - 211 ): Each of two players receives a "hand," which is 
a randomly equidistributed number x in the interval 0 < x < 1 , and de¬ 
clares a bid a. in the interval a>dk>b (a>b>o), this declaration 
being made with the knowledge of his own hand, but in ignorance of his op¬ 
ponents hand and bid. If the bids are of equal size, then the hands are 
compared, and the player with the weaker hand pays his opponent the amount of 
the bid. If the bids are unequal, the player who has made the smaller bid 
pays this amount to his opponent. He has no option of "seeing" his opponent 
(i.e., of matching the bid), nor are hands compared. 

There are two cases to consider: 

(I) All bids <*. In a > ck > b are allowed. 

(II) Only a finite number of possible bids: 

a =* a, ) a n ) ... ) a , ) a = b 
are allowed. 

The whole discussion that follows will be more informal, and In 
parts ( 2 ) and (4) more heuristic, than the discussions In "Theory of Games" 
or In the preceding paper. The definitely formulated conclusions and their 
proofs are, nevertheless, rigorous. 

$ 2 . CASE (I): A CONTINUUM OF ALLOWED BIDS 

2 . 1 . Let us analyze a potential good strategy -- since the game 
is symmetric, it does not matter for which player. 

Assume that for all hands x > x Q , where x Q is a constant to be 
determined, the strategy provides always betting a, i.e., the highest pos¬ 
sible bid- For the other bids dJ (i-e., a > ©t 1 ^ b), let <|>(cOddk be the 
a priori probability (i.e., the one integrated over the random equidistribu- 
tion of hands x) that dk‘ is in the (infinitesimal) interval from dk to 
dk + d«k. 

Assume that for x < x Q the expected value of the game is the 
same for all choices of the bid ok*, if the opponent plays this strategy. 

The expected value in question is 

( 2 . 1 . 1 ) *$(<*) dd - d' [ (M«Odd+ (1 -x 0 )j . 

The independence from cO is best expressed by stating that the dk»-de¬ 
rivative of this quantity is zero. This gives 
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2dJt(dk') - a 0(«Oda. + (1 - X Q ) J =0 


Another differentiation (and writing ■*- for <*.') gives 

2*0'(*) + 30 («*•)- o , 


l.e. 

whence 
(2.1 -3) 


0 1 
h 


&i _ _ 2 1 


*(dl) - k** . 


Substituting (2.1.3) into (2.1 .2) gives 


(2.1.4) 


2ka - (1 - x Q ) - o . 


The definition of <1>(c0 implies 

a j 


i.e. 


J 


0(ol)dd. + (1 - X Q ) = 1 , 


;/ 


0(ok)dd. - X Q = 0 


Substituting (2.1 .3) gives 


(2.1 -5) 


2kb 2 - 2ka 2 - x Q = 0 . 


Prom ( 2 . 1 .U), ( 2 . 1 . 5 ) by addition 


2kb 2 - 1 - 0 , k = 1 b 2 , 


so that (2.1,3) becomes 

( 2 . 1 . 6 ) 

and then (from (2.1.4)) 

i.e. 


0(dL) - lb 2 a" 2 , 


i 

( a )2 - 0 - x 0 ) - o , 


x - i - (|) 2 . 
o a' 


(2.1 -7) 
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2 . 2 . With the choices ( 2 . 1 . 6 ), ( 2 . 1 . 7 ), the expression ( 2 . 1.1 
is independent of d f , hence its value for all d’ is the one that it 
for d' * b, which is obviously - b. I.e., for any hand x < x_ and 

t = 0 

bid d the expected value of the game is the same: - b. 

The expected value of the game is still given by the expression 
(2.1.1) for a hand x < x Q , provided that the bid d* is < a. I.e., it 
is still - b in this case. For a hand x > x Q ana the bid «l‘ = a, 
however, (2.1.1) must be replaced by 

£ b J + a(x - x Q ) J - a(1 - x) . 

This expression has the x-aerlvative 2a, and for x = x Q it goes over 
into (2.1.1) (with <*' = a), i.e., its value is then - b. Hence its 
general value is - b + 2a(x - x Q ). 

Summing up: 

f The expected value of the game for the hand x and the 
(2 2 1 ) < bici * (If tlle opponent plays the strategy under con¬ 
sideration) Is - b, except when x > x Q , d = a, in 
c which case it is - b + 2a(x - x Q ). 

2 . 3 * ( 2 . 2 . 1 ) implies this: In order that a strategy be optimal 

against the one considered above, it may allow any set of bids d for hands 
x < x Q , but it must prescribe the (highest) bid d = a exclusively for 
hands x > x Q . 

The strategy considered above (i.e., the one introduced in (2.1), 
with the determinations (2.1.6), ( 2 . 1 . 7 )) itself fulfills this condition. 
Hence it is optimal against itself, i.e., it is a good strategy. 

Note, that the definition of (2.1) actually allowed for a whole 
family of strategies, all of which, according to the above conclusion, are 
good. Indeed, for bids d < a, only the a priori probability density 
♦ (d) is specified, but not the conditional probability density <Md,x), 
for a given value of the hand x. This, more detailed, structure of the 
bidding-rule has thus no influence on the goodness of the strategy. 

This phenomenon may seem strange, but it is quite understandable. 
All bids d< a are (in these strategies) induced by probability densities, 
i.e., the probability of any one individual value d < a is 0 . Hence the 
probability for two opponents, whose bids dj ,<* 2 happen to be both < a, 
to make (accidentally) equal bids dj « is also 0 . It is in this case 
only, however, that their respective hands affect the outcome. 

In the case (II), where only a finite number of bids are possible, 
individual bid-values with non-0-probability will be the rule. In this case 


_ 1 ! 
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3 1 * 


the hand and the bid will therefore interact substantially in determining 
good strategies, as will appear in the course of (3), especially in (3*3.2) 
and in the concluding section (3*9). This will lead to very definite 
"fine structures" for good strategies, which can exhibit various peculiar 
oscillatory phenomena when the number m of possible strategies tends to » 
These are in some ways analogous to the "weak convergence" phenomena for 
poker with a finite number of hands, as discussed in the preceding paper. 


$ 3- CASE (II): A FINITE NUMBER m OF ALLOWED BIDS 


3-1. Let us again analyze a potential good strategy — since the 
game is symmetric, it does not matter for which player. 

Let © v (x) be the probability of the bid a v (v = 1, ..., m) 
when the hand is x. Hence 

(3.1.1) e v (x) > o , 2 v e v (x) = i . 

The a priori probability of the bid a y is then 

(3.1 .2) ^ e v = J e y (x)dx , 

of course 

(3.1 -3) e v £ ° , S v 9 v = 1 * 


Consider the expected value Y y (x) of the game for the hand x 
and the bid a y . If the opponent plays this strategy. Clearly 


(3 -i •*> v x) = • a A<v e v 

Prom (3.1 .<0 

(3.1-5) y y (x') - r v (x") = 26^ 


* (y)dy - J\,(y)dy) . 

XV 

x „J e v (y)dy . 


This makes It also clear, that Y y (x) is continuous in x. 

3-2. From this point on rigor requires the use of (Lebesgue-) 
measure theory. We will try to do this without disrupting the Intuitive 
pattern of the deduction too badly. 

We call x a v-point, if for every open interval I with 
x € I the y € I with 9 y (y) ^ o have a measure ^ 0. 

Let x* be a v-point, and x" < x' not a v-point. The 

x > x *' which are v-points form a closed set This set contains x 1 , 

* * 

hence it has a minimum element x . The set does not contain x*', hence 



TWO VARIANTS OP POKER 


35 


x > x' ' . Thus x is a V-point, while no x in x > x £ x' * is a 
y -point. By virtue of the usual covering theorems the y in x* > y > x ,r 
with 0 y (y) ^ o have measure o. . 

Consider an open Interval I with x* £ I. Then the y £ I 
with 0 y (y) ^ o have measure jL o. 

Consider an open sub-interval J of the open interval 
x* y y y x'' . Then (3*1 *1) implies the existence of a f* such that the 
y £ J with d (y) / o have measure ^ o. Hence fL ^ y. 

r 

Now the goodness of the opponent's strategy excludes 
r <y) > JT v (y) on a set with measure ^ o where e y (y) / o, hence there 

exists a y' £ I with JT^(y ’) < jr^(y') • Similarly, it excludes 

K v (y) > X (y) on a set with measure ^ o where e^(y) / 0, hence there 

exists a y'' £ J with y (y *') > y (y"). 

Hence ^ 


yjy') - r(y) < o , y (y) - » (y) > o , 

^ V = /*■ V * 


therefore 


tyr) - yr)] - nr v (y'> - yyn - 

[y^(y') - y y (y’)] - lx (y") - x v (y)] < o , 

and so by (3-1*5) 


( 3 - 2 . 1 ) 


;/( 


*eV x> - 


a 0 

V V 


(x)) dx < 


Now let I converge to x* and J to x' 1 . Then 
y' —> x*, y' ' —■> x'' - ft (^ *v) may vary, but some value of ft (^ v) must 
be assumed infinitely often in this convergent sequence. Restricting our¬ 
selves to this subsequence, we may assume y. to be fixed. Hence (3-2.1) 
becomes 


(3-2.2) 2 • (a^(x) - a v e y ( x )) dx < o . 

We saw above, that the y in x* > y ^ x' ' with © y (y) ^ 0 have 
measure 0. Hence (3-2.2) becomes 


2 • f a 0 (x)dx < 0 , f e (x)dx < o . 

x"J H p * x" j ^ 

Owing to (3-1-1) this means, that the y In x* > y > x' 1 with e^(y) / 0 
have measure o. This contradicts the fact, that there exist open sub¬ 
intervals J of x* > y > x'', such that the y £ J with 
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• (y) / o have measure ^ o. 

In view of this contradiction our original assumption must have 
been wrong. I.e.: 


x * a V-point, then every x'* < x* is a 
V-point, too. 


Assume that v-points exist. They form a closed set, hence it 
has a maximum element of course 0 1- no v-points exist, 

put | v * 0. At any rate, no x in < x ^ 1 is a v-point. By virtue 
of the usual covering theorems the x in < x < 1 with ©y(x) ^ o 
have measure 0. In view of the two-way definition of | , at least 

every x in o < x < Is a v-point. 

SS 

Now consider two x',x M with o < x' <£ |^, 0 < x*' < | . Con¬ 
sider two open intervals I , ,I'* with x' G I', x" G I". Then 6» 
y G I* with © y (y) o have measure ^ 0 and the y G I" with 
0^(y) ^ 0 have measure ^ 0. The gooaness of the opponent's strategy 
excludes ^(y) > * v (y) on a set with measure ^ 0 where ©y(y) ^ 0, 
hence there exists a y' £ I' with y') < y y (y'). Similarly, it ex¬ 
cludes JTy(y) > y^(y) on a set with measure ^ o where e (y) / o, hence 

there exists a y" G I" with y (y'') > yly' 1 )- 

i “* v 

Prom this point, the argument used further above, leads to (3.2.1) 
for these y^y'*. Then, letting I 1 converge to x' and I*' to x'' 

gives y' —> x', y* 1 —•> x'', and hence (3-2.1) gives 


(3-2.4) 


x *f (VV X) ‘ W x) ) dx < 0 • 


Assume next o < x', x'' < Min (?^5 V )- Then (3-2.4) holds for 
f*,V as they stand, and also with them interchanged. Hence 

x 1 


i-e. 

(3-2.5) 


7 

X" J 


C ( a 0 (x) - a e ,(xA dx 
»J v v v ; 

7 


0 , 


a e (x)dx 
r r x ,f 


Vv (x)dx 


(3-2.5) can also be stated as follows: For every open sub-inter¬ 
val K of the interval o < x < Min , the two functions a^e^(x) 

and &y© v (x) have the same integral over K. Prom this, the usual theorems 
about integration permit us to conclude, that the x in 
0 < x < Min (|^,5y) with «ye^(x) / a v e y( x ) have measure 0. 

Summing up: 
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( 3 - 2 . 6 ) 


The | v (v - 1, m) have the following properties: 

(a) 0 i *V i 1 • 

(b) The x in S v < x £ 1 with e y (x) / 0 have 

I measure 0 . 

(o) The x in 0 £ x < Min (4^. | y ) with 

^ a e (x) / a e (x) have measure o. 

u. u. ' VP 


3.3. Let A be the sum of the sets defined in ( 3 * 2 . 6 ), (b) 
and (c). By ( 3 - 2 . 6 ) A has measure 0 . 

Assume that Max £ y < 1. Then there exists an x $ A with 
Max | y < x < 1 . Hence by ( 3 - 2 . 6 ), (b) all e y (x) = o, contradicting 
(3.1.1). Therefore Max f y = 1, i. e., 


(3-3.1) 


Some Sy = 1 • 


Consider an x ( A. By (3*3.1) y with )> x exist. By 
( 3 . 2 . 6 ), (c) a y © v (x) has the same value for all such y, say f( = f(x)). 
Hence ( 3 - 2 . 6 ), (b) and (c) give 


V x) 1 


for > x , 

for < x . 


Now (3-1 • 1) gives 


1 


l.e. 


f f ■ \ (f) ' 

^ ^2* V V 


(3-3.2) 


e v (x) ■{ 


\ («r) 

' a j*V 


f ° r i v 1 x 


for | v < x 


Since A has measure 0 , the e y (x) for xU can be re¬ 
defined in any manner, without changing the strategy relevantly. Now 
( 3 . 3 . 2 ) is a possible definition of the e y (x) by ( 3 * 3 . 1 ), and it fulfills 
(3.1.1) — no matter what x. Hence we can use ( 3 . 3 . 2 ) to redefine the 
0 y (x) for x £ A. 

This has. the effect, that ( 3 - 3 . 2 ) holds for all x. This will be 
assumed from now on. 
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Thus the strategy is completely determined by (3/3.2), and 
( 3 . 3 . 2 ) is stated wholly in terms of the Hence there remains only the 

task of determining the 

3 .^. Assume that *= 1 for some v ^ 1. Then by (3*3.2) 
always e y (x) ^ 0 , and also 9 y ^ 0 . Hence the goodness of the strategy 
allows ^(x) > r y (x) only for a set of measure 0. I.e., with such 
exceptions 

(3.^.1) V x) < V x) • 

By continuity, (3.^.1) holds without exceptions. 

From (3.^.1), l^O) < y y (l), hence 

1 a ^c 0 /u. a v^ / 4<v % ' 


i.e. 


+ a v^ 0 /* 0 ' 

i.e. * ° for f*. < v* Again from (3.^-1), *^(0) ^ y v (°)> hence 

^>1 VV ‘ a i 9 i - W' a v ^<V ®v ’ 

i.e. (since * 0 for yu.< v, and since v ^ 1) 

2 a v e v £ 0 • 

Hence e y = 0 , contradicting ^ 0 (cf. above). 

Hence the original assumption must have been wrong. I.e.: 

(5.4.2) $ y < 1 for V = 2, .... m • 

Now ( 3 . 3 . 1 ) necessitates 

(3.4.3) i, = 1 . 

Assume next, that some | y ■ 0 . Choose the minimal V with this 
property. By (3.^*3) V ^ 1, hence « 0, $ > 0. Then by (3.3.2) 

fcy^Cx) 1* 0 for ° £ x < g y-1 , and also 9 y - 0, e v-1 > 0 . 

Hence the goodness of the strategy allows jr y (x) > ^ y-1 (x) for 
these x only for a set of measure 0. I.e., with such exceptions 
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(3.4.4) i Vi (x) for 0 1 x 1 Vi * 

By continuity, (3*4.4) holds without exceptions. 

Prom (3-4.4), y y (o) < y y-1 (o), hence by (3-1.4) 

a ^V " a V 0 f4. 1 v “ Vi V 

In view of 0 y = o this means 

( Vt - V £*» V ^ 0 • 

Hence 0^ * 0 for ft < v, contradicting 0 y-1 > 0. 

Hence the original assumption must have been wrong. This means 
that all g y ^ o, i.e.: 


(3.4.5) 0 < g < 1 for all v . 

Y SB 

3-5. For 0 < x < Min g A all 0 y (x) ^0 (cf. ( 3 . 3 * 2 )), hence 
the goodness of the strategy * allows tf^(x) > X y (x) for these x only 
for a set of measure o. I.e., with such exceptions 

(3.5.1) ¥jx) < JT (x) for 0 < x < Ming . 

n * y = == A a 

By continuity (ana in view of (3-4.5)) (3.5*1) holas without exceptions. 

Putting x = 0 in (3-5*1), and considering that it holds for 
all pairs fgV (= 1 , ..., ra), gives 

(3.5.2) ¥ l( 0) - ... - tj 0) . 

We will use ( 3 . 5 . 2 ) to determine the remaining unknown quantities, 
i.e., , ..., g m (cf. the remark at the end of (3-3)). Before we do 

this, however, we will discuss the general significance of ( 3 * 5 * 2 ). 

3 . 6 . The assumed good strategy under consideration, i.e., the 
© v (x), is defined by ( 3 . 3 . 2 ); the auxiliary quantities 0 V are then 
defined by ( 3 .1.2). (3-3.2) implies (3-1.1), (3-1.2) then implies (3.1*3). 

In order that (3-3-2) be meaningful (for all x) (3-3.1) must be required. 
We will also use (3.4.5). (We will, however, not need (3-4.2) and (3*4.3); 
we will rederive these.) In addition the condition (3.5*2) (based on 
(3.1.4)) holds for every good strategy. 

We will see in (3*9) that these requirements determine a unique 
strategy (i.e., a unique system g 1 , ..., g ffl , cf. the remarks at the end 
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of ( 5 * 5 ) and of ( 3 * 5 )) • In view of this the existence theorem for good 
strategies implies, that the strategy in question, which is the only one 
that can he good, is indeed good. However, the proof of the existence 
theorem -- "Theory of Games," section 17*6 (pp. 153 - 155 ) — does not cover 
the case of a continuum of hands. It is true that its extension to 
families of games that cover this case is well known and not at all diffi¬ 
cult. Nevertheless, the situation, as outlined, is complex enough, that it 
seems natural to prove the goodness of a strategy fulfilling the above 
conditions directly. 

This proof is quite simple. It runs as follows. 

It suffices to show, that ir v (x) > #^(x) implies e^(x) « 0 
(we could, of course, except a set of measure 0, but we do not need this 
now) — this means that the strategy in question is optimal against itself, 
i.e., good. 

Assume r^(x) > lf^(x) . Then by (3-5.2) * v (x) - * v (0) > *^(x) - 
y^(0), hence by (3-1.5) (with x,o for x',x'') © v (y) > ©^(y) for some 
y r £ x. By (3.3.2) © v (y) > ©^(y) occurs only if g y y, < y. Hence 

x. Now (3.3.2) implies ©^(x) = 0. This completes the proof. 

3.7. We proceed now to the complete determination of the strategy 
under consideration, on the basis of (3•5 • 2) (cf. (3.5) and (3.6)). 

(3.5.2) Is equivalent to 
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(3.7.3) 


*!*•<? > 


^-2 
+ a_, **1 


Wi ^< v+1 /* ' 


Now {3-1 -3) states, that 5L<n ®„ " 1 > hence (3.7*3) Is again equivalent 
to = ^ 


(3-7-*0 


V a 2a in 

^K v /*• Vi + ■ 


2 a, 


V+1 


a + 


Vi 


This is valid for V * 1, ..., m. 

(3.7-^) can be rewritten to express the © v themselves: For 
V * 2, ..., m © v obtains from (3 * 7 . *0 for v minus ( 3 • 7 • *0 for y - 1 ; 
for V * 1 © v obtains from (3-7.M for v* Hence 


2a m 


(3.7.5) © v { 


a m-l + S 

2a m 

a m-l + Si 


2 a 0 


2 Vi 


a v + Vi 


V-1 


- a 


Vi 


for v = 1 


for y = 2 , 


Thus (3.5-2) is equivalently expressed by the actual determina¬ 
tion of the © v by (3.7.5) • We must now pass from this to the determina¬ 
tion of the 

3 . 8 . Assume £ £ £ . Then (3*3.2) gives a^U) > a e^Jx) 
for £ ]> x ) J , and a^S.^^ = a^Jx) otherwise. Hence by ( 3 . 1 . 2 ) 
W > V VV lf,t *v > ^ and Vv = VV lf = Ik- Interchanging 

h V 8 ±ves Vv < VV lf lv < V 

Summing up: 


( 3 - 8 . 1 ) g | if and only if a^ | a^, respectively. 

Thus the , which are given by (3*7.5), give in turn the 
ordering of the by ( 3 . 8 . 1 ). 

Let Ttj, ..., 7r m be the permutation of 1 , ..., m, which 
establishes a monotone non-decreasing ordering of the & v e v : 

(3.8.2) a e <...<a^e • 

11 — mm 


(If some a v © y are equal, then this definition of the 1*^ is non-unique 
to that extent, but this is irrelevant.) 

( 3 . 8 . 1 ) now guarantees 
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The determination of the iv must be based on (3«3»2) with 
(3.1.2). (3.1.2) can be written in this form: 


a 9 
V v 


J 


a v O v (x)dx (v « 1, .... m) , 


or equivalently 


= 'f & - '• m) » 


or, still equivalently 


( 3 - 8 . 4 ) 


f VS • V, V,' 

(/* = 1, ..., m) , 


where (x) are taken to be 0. 

°Nov 0 it 0 is clear from (3-3.2), that the right-hand side of 
( 3 . 8 . 4 ) is 


( 3 - 8 . 5 ) 


S ~ S-i 

sir, ’ 


where , too, is taken to be 0. Note, that for > f* > the 

condition 0 ^ 5ic can be replaced by <r £ />, while for 

itr- * Sir # the expression (3.8.5) is 0 anyhow. With this proviso 

r f* — \ 

then, (3.8.5) transforms into 


a_ e«- - a_ e 


g V " S -1 


«P *> Vi *>-i Sr>, J- 


1 . e. 

(3.8.6) j 


S" S-i ~ v) (VS* " %_i%.i) 

(/» - 1, .... a) . 

By summation this goes over into the equivalent system 

(3.8.7) J - 2 r <, ( 2r>r a '-) (\\ - V,V,) 

(^ - 1, ..., m) . 
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Abelian re-summation of ( 3 - 8 . 7 ) gives 

( ^«->p a^) a * f e * f + 2t<,(S,> t ’ ^T>t+1 a^) a « T 0 « T ' 

The general term of the sum S T / e is —. a 9 -- 6 . Hence 

*t*t w r 

S* = ( X) VS + ^ T<( ° 0n T ’ 

i.e., 

~^<f % + (^<r> ^ T )\ /I 6 n r 

if - 1, * * •, m) . 



Thus ( 3 * 8 - 7 ) and (3*8.8) are equivalent to each other and to (3*1*2.). 

(3*8.7) makes it clear, that o < < ... < • (3*8.8) and 

( 3 * 1 * 3 ) (which follows from ( 3 * 7 * 4 ), and hence 1 from m ( 3 * 7 * 5 )) give 

^ * 1 * Hence 
m 

( 5 . 8 . 9 ) °< lit < ••• Sir < 5 -" 1 

1 — m-1 m 

follows from our present definitions. Thus ( 3 * 3 * 1 ) and ( 3 * 4 . 5 ) are 
verified, as well as (ex post) the relevant property of the permutation 
V •••’ ^m ( 3 * 8 . 3 )) • 

3*9* (3*7*5), (3*8.2), (3*8.8) contain a complete definition of 

the 0 V and hence with the help of (3’.3*2) the ©^(x) are completely 

defined. I.e., we have completed the determination of the good strategy, 
and shown that it exists and is unique. 

We observe further: By ( 3 * 7 * 5 ) 

a e - 2att 2a 2 a 

11 a m-l + a m * ••• ' a l + a 2 1 ' 

and for y - 2, ..., m 


♦ 




hence 
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a v°v . a v -2 + a v-1 


>!!*=< 

/ Oa 


a 1 + a 2 ®V-1 ' % 


2a V-2 ' ••• ' 2a 1 ' V-1 ‘ 


Now (3•8•1) gives 


Vi ‘ a v 


a i e i > a v°v • 


(3.9.1) 


I, > i v for V- 2 , .... m , 


and therefore ( 3 . 8 . 2 ) prescribes (unambiguously, cf. there) 


(3.9.2) 


Tt = 1 . 

m 


This verifies (3-4.2) and (3-4.3). 

$ 4. GENERAL CONSIDERATIONS 

4.1. It Is of interest to see, how the case (II), corresponding 
to a finite number of allowed bids (treated in (3)), converges to the 
case (I), corresponding to a continuum of allowed bids (treated in (2)), 
when the allowed bids of the former (cf. (II) in (1)) spread densely over 
the entire allowed interval of the latter (cf. (I) in (1)). 

Consider first the general situation, where a finite number m 
of bids, according to (II) in (1), Is allowed, and where the mesh-width 


(4.1.1) 


i ‘ ^ ( Vi - V 


of this bid-system converges to 0 . 

Let an <*' with a ^ £ b be given. Choose v with 

a v £ ^ ■ Th® n by (3«7.*0 


W V ^ “ I*. a A _ 1 * 
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^A>V ln ( 


1 + 


1 A-1 


Replacing ln( 1 + ~ -A ) by I ln( 1 + — -- ) changes it by 

0((a A-1 - a A ) 2 ), i.e. by 0(^(a A _ 1 - a A )) . Hence* the entire X^y^ is 
changed by 0(£(a y - a m )), i.e. by o(£(a - b)) 3 i.e. by 0 (e). Thus 


X 0 « e 

V' _ 2 

~ e 


1 

A>V 2 


i In + 0(t) 


- I ln -^ + o(t) 
= e d a m 


-<’ + 0 U)) (i:) 

x m ' 1 
/a * 

^ o * °(i))(r) • 


Now = b, a v = di 1 + o(t) = (1 + o(s))di‘, hence 

2 . . v . ( , 


>4* 


I.e.: 
(4.1-2) 


2 V . ^ 

a ,> ^ 


■> ( ^ ) for £ —> 0 • 


The right hand siae of (4.1.2) is equal to 


(4.1 -3) S f + (1 - x G ) , 

«L' J 

with the <|>(d0 of (2.1.6) and the x Q of ( 2 . 1 . 7 ). I.e. the a priori 
probabilities for the bids a y define a distribution that converges 

(for l —■> 0) to the distribution with the cumulative distribution func¬ 
tion (4.1 . 3 ) — i.e. with the probability density $(<*) in a > <*. £ b and 
the point probability 1 - x Q at <k ~ a. According to ( 2 . 3 ) this is 
precisely the distribution of a priori probabilities of bids that character¬ 
izes the good strategies that were obtained in ( 2 ) for the continuum case, 
i.e. (I) in ( 1 ). 

In other words: If the mesh-width of the bid system (cf. (4.1.1)) 
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converges to o, the distribution of a priori probabilities of the bid 
system for case (II) converges to that one for case (I). 

To this extent, then, we have continuity. 

4.2. The behavior of the a priori probabilities, i.e. of the 
e v (or, rather, of the ® v )> turned out to be continuous. Let 

us now consider the e y (x) themselves, or, which in view of (3-3*2) 
amounts to the same thing, the £ y . 

Consider again the set up of 4.1, more specifically £ —> o for 
the £ of (4.1.1). We will prove, that this is compatible with a wide 
variety of behaviors for the J v . 

We observe first, that (3*7*3) implies 

2* ^ 2a^ 1 6 /a. 1 


i.e. 


i.e. 


a v ^/*<v Q /jl ^ a v+i S/*<y+1 Q fL 


(4.2.1) a y 13 a monotone decreasing function of v. 

In addition to this, obviously, 

* 

(4.2.2) e jt 13 a monotone increasing function of V« 

Prom these (with y- 1 in place of V): 

y ls a monotone (decreall^ 5 functlon of 


(^- 2 - 3 ) < 


V (- 2, ..., m), if a y - a,,., 


{ 


« cT a, 


v-i 


[_ («^ constant), i.e. if the a y form an ^ometric°* progression. 
Now by (3-7.2) (with y - 1 in place of v) 

(k.z.k) a v e v - i (a v - a y _,) X^y-y V for ^ " 2 ' 


Containing (4.2.3) and (4.2.4) with (3-8.1) and <3-9•1) gives therefore: 
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(4.2.5) 


l 2 ^ * * ‘ ^ ^ 

*m < -<*2<*i 


f arithmetic, ___ 

geometric ] Progression. 


if the a y form an 


Hence ( 3 . 8 . 2 ) prescribes (unambiguously, cf. there): 


(4.2.6) 


*1 

- 2, . 

V, 

II 

B 


*1 

“ XD, * 

Vi 

CM 

II 



if the a v form an 


f arithmetic, 

geometric progression. 


The arithmetic progression is given by the formula 

a v = a ^T +b ^T* 

and the geometric progression Is given by the formula 


m-v v-1 

(4.2.7.b) a v = a “- 1 b m - 1 

As m —y 00 , both bid-systems (4. 2 .7*1) and (4.2.7-b) spread 
densely over the entire interval a^d^b — i.e. in both cases the 
mesh-vidth £ of (4.1.1) converges to 0. Nevertheless, (4.2.5) shows, 
that the two bid-systems command altogether different good strategies 
(i.e. "bluffing" procedures): The hands x < ^ > are the ones which do 
not command the highest bid (a 1 ) exclusively (cf. (3*3-2)) — i.e. these 
form the range for "bluffing," in the sense of the interpretations of 
"Theory of Games," section 19-10 (pp. 204-207). (3*3*2) and (4.2.5) show, 

that in this region weak hands favor high bids when the bid-system 
(4. 2 . 7 .a) is valid, while strong hands favor high bids when the bid-system 
(4.2.7-b) is valid. 

(4.2.6) permits calculating the £ v in both cases. This can be 
used to illustrate the points made above further, but we will not go into 
this in detail at this occasion. 

4 . 3 . Actually, the permutation v —»% of 1, ..*, m (cf* 
(3*8.2) and the text that precedes it) can be prescribed entirely at will, 
as long as the necessary condition ir * 1 (cf. (3*9*2)) is fulfilled. 

This can be shown as follows. 
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Assume v - 1, .... m - 1. In view of ^ = 1 (cf. 

(3-1.3)), (4.2.2) implies 2^ ^ < 1, and ( 4 .2.1 ^implies 

a v e r > V Slnce a v ? a l ” a ' a m “ b > there follows 
(4.3.1)' | < ^ < 1 for v = 1, ..., m - 1 . 

Replace v by v - 1 In (4. 3 . 1 ). Then (4.2.4) gives 


(^. 3 . 2 ) 


— -i(a - a ,) < a 9 ^i(a - a ,) 
a 2 K v v*l N i) v N 2 ' v v- 1 1 

for v = 2 , ..., m . 


Let fy , ..., f be the inverse permutation (of 1 , ..., m) to 
TCj, ..., ir m . Assume that 

p 

(4.3-3) a y - a v _, - h(|) v for v - 2, ..., m, 


for a suitable constant h (> 0) . Then (4. 3 . 2 ) becomes 


(4.3.4) 




V 


/ii"l 


< a y 9 V < ? li * 

for V =• 2, 




New P v > (/*, V = 2, m) Implies /° v - 1 > ana thence by 

(4.5.4) a v © v > a^e^. I.e. the a v © v are monotone increasing functions 
of f> v for y - 2 , ..., m, i.e. for v ^ 1 . Therefore the are 

monotone increasing functions of P for tc^, / 1 , i.e. (because ^ of 

the stipulation of ir^ = 1 , cf. above) for P ^ ra. The exclusion of 
^* = m may be removed because of ( 5 - 9 - 1 ) (ana the stipulation of Tt^ ** 1 ). 
So we have: 


(*•3-5) a e < ... < a 0 . 

u l U 1 , ^ nm 

In view of (5-8*2) this means, that these 1C|, ..., IT are indeed the 
(unique) , ..., of the present example. 

There remains the task of safeguarding (4.3-3). Since a 1 ~ a, 
(4.3.3) Is equivalent to 

(4.3.6) a v - a - h^y (§A • 

This condition a * a 1 > a 2 > ... > a m-1 > a m = b is now automatically 
fulfilled, except for a m « b. This means 
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i.e., since /^ , ..., f m is a permutation of 1, ..., m, 



Hence 

(4.3.7) 



meets this requirement. 

4.4. Examples of various kinds could be multiplied beyond this 
point. Instead of pursuing this, we make the following general remarks 
about the ordering of the according to size. 

The position of g 1 , in this ordering is determined a priori by 
(3-9.1): It Is the largest one. Hence we need to consider the | v with 
V =r- 2, ..., m only. Combining (3-8-1 ) and (4.2.4) shows, that the 
ordering of these g v coincides with that one of the 


(4.4.1) ( a v " a v _ 1 ) ^^(y _ -J ^fJL ' 

Now let the bid-system of (II) in ( 1 ) spread densely over the 
entire interval a > c* b — i.e. let the mesh-width e of (4. 1 . 1 ) con¬ 
verge to 0 . Consider the two factors of (4.4.1) separately. 

The second factor of (4.4.1) was dealt with in (4.1), and it was 
seen to converge to a simple function of <*' -- the connection between ol* 
and V being given by > a y (this obtains from the corresponding 

condition in (4.1) by replacing v by y - 1 ). This function of pl' is 
given in (4.1.2), and Interpreted in (4.1.3). It is continuous in *•, 
hence asymptotically infinitesimally slowly varying in v. 

It follows therefore, that the ordering of the quantities (4.4.1) 
(i.e. of the § v referred to above) is determined primarily (i.e. apart 
from "long range effects" in v, i.e. effects that manifest themselves 
only on the -scale) by the first factor of (4.4.1), which is a v-1 - a p . 
In the relevant comparisons of size, of course, only the relative sizes of 
the a^_ 1 - a y matter, those belonging to "remote" v-regions (i.e. to 
regions relevantly separated on the pl'- scale) being weighted against each 
other asymptotically by the limit of the second factor of (4.4.1). This is 
the function of oi* given in (4.1 . 2 ) . As a weight function this amounts to 

(cL 1 ) or> which comes asymptotically to the same thing, to a y 2 . 
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With these reservations, then, the ordering of the | v in ques¬ 
tion corresponds to the ordering of the a v ^ 1 - a y . This quantity is the 
excess over a v of the next higher bid, a v-1 -- i.e. the minimum overbid 
over a v . 

This result lends Itself to an easy and plausible interpretation. 
The minimum overbid over a given bid (a v ) expresses in some sense the 
degree of defensibility of this particular bid. Indeed, it specifies the 
price (as an increase in risk when met by still higher bids, or by the same 
bid combined with the differential danger of a stronger hand) at which the 
bid in question can be defeated. It Is plausible, that the strategic de¬ 
sirability of any particular bid should be reduced at will by allowing 
"cheap” overbids over it. The remarkable thing about our result is, that 
it furnishes (by way of (3*3.2), together with ( 3 . 8 . 2 ), ( 5 . 8 . 8 )) a quanti¬ 
tative Implementation for this qualitative Insight. The asymptotically 
defined long range conparison principle for the minimum overbids 
(a y _ t - a v ) 1 with the help of the weight function introduced further above 
(a v ”2) Is a particularly striking phase of this, but It is only 
one phase. The complete result Is the one as summarized at the beginning 
of (3.9). 
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THE DOUBLE DESCRIPTION METHOD 1 
T. S. Motzkin, H. Ralffa, G. L. Thompson, and R. M. Thrall 

INTRODUCTION 

The purpose of this paper Is to present a computational method 
for the determination of the value and of all solutions of a two-person 
zero-sum game with a finite number of pure strategies, and for the solution 
of general finite systems of linear inequalities and corresponding maximi¬ 
zation problems. 

Although a system of linear equations forms a particular case of 
a system of linear inequalities, the comparative efficiency of numerical 
methods of solution is very different for the two. In the case of linear 
equations it is as yet undecided whether direct or Iterative methods are 
generally preferable, the aim of both types of methods being to solve a 
system which is supposed to be non-singular and, therefore, to possess a 
unique solution. 

For inequalities all numerical methods hitherto used, including 
probabilistic methods and descent methods with or without distance check, 
are essentially approximative and reach, after a finite or infinite number 
of steps, a particular solution. However, systems of linear inequalities 
correspond, in general, to singular systems of equations and may have none, 
one, or infinitely many solutions. If it is desired to determine the 
totality of solutions (in parametric form) these methods will not do. 

The totality of solutions of a finite system of linear inequali¬ 
ties occupies a bounded or unbounded convex polyhedral set in Euclidean 
space whose description may be of theoretical interest. In applications 
when minimization in various directions is required, as for example, in 
optimization problems within an otherwise fixed economy with variable price 
vector, the full determination of the solution set may be necessary or 
time-saving. 

This determination can be effected by any one of the direct 


1 The preparation of this paper was sponsored (in part) by the Office of 
Scientific Research, USAF, and (in part) by the Office of Naval Research. 
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methods. Among them determinants are impractical already for equations. 

The other direct methods amount to progressive reduction of the coefficient 
matrix by left or right multiplication. 

A particular procedure of left multiplication is the elimination 
of the unknowns, one by one, and this method (which for equations, though 
very much older, is called the Gauss method, and is one of the best bets 
in the race for maximum efficiency) was proposed for linear inequalities by 

p 

Fourier [ 1 ] but seems to be entirely out of question because of the huge 
number of elementary operations involved, which grows extremely fast with 
the number of unknowns and inequalities. 

Right multiplication on the other hand, as represented by the 
successive solution of one, two, etc., inequalities until arriving at the 
whole system seems to be within the range of machine, and sometimes of 
hand, computation, as we hope to corroborate in the present paper. The 
advisability of the same method adapted to systems of equations is under 
consideration. 

The idea was, as far as we know, first used in the dissertation 
of T. S. Motzkin ( 2 , pp. 24-26] for purely theoretical purposes (a proof of 
a generalization of Minkowski*s theorem on the finiteness of a base for all 
solutions of a finite system of linear inequalities). 

Independently Raiffa, Thorrpson, and Thrall [ 6 , 7 ] developed the 
corresponding computational scheme for the case of finite games.^ The.ex¬ 
position of this scheme is given in Parts I and II. The number of steps 
In determining the solutions for one player Is equal to the number of pure 
strategies of the other player. Frequently the solutions for the first 
player can be used to shorten the computations for the solutions for the 
second player. A technique which enables one to determine optimal strate¬ 
gies for player II utilizing the computations for player I is being 
investigated. 

Again Independently, the computational scheme for general systems 
of linear inequalities was given by T. S. Motzkin [ 3 ). This procedure 
forms the content of Part III. 

PART I. INTUITIVE CONCEPTS OF THE GAMES 
{ 1 . NOTATION 

Let A « |la^lI be the matrix of a two-person zero-sum game in 

^Numbers in square brackets refer to the bibliography at the end of the 
paper. 

5 This procedure has since been adapted for Linear Programming. 
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which player I has m pure strategies ^ , «t 2 , ..., <A m and player II has 
n pure strategies , 0 2 , with payoffs to I and -a.y to 

II If the strategies are chosun. A row vector i = •••* t P ) 

will he called a probability vector of dimension p if $ = o (i.e., 
each « 0) and if + ••• + Ip ~ 1 • We denote by S p the set of all 
probability vectors of dimension p. We admit as mixed strategies for 
player I the set of all probability vectors | having m components and 
for player II the set of all probability vectors having n components. 
The corresponding payoffs will be 

( 1 ) 

m 

to I and Ejj(^,»|) = -Ej(£) to II. (Here rj denotes the transpose 
of »|.) 

Let the row and column vectors of the matrix A be denoted by 


( 2 ) 


R i ~ 1|a 11' •••' a in^ 




(3) 


“U 

a mj 

We then have 

E i<M> i ( R v f) 


The vector x « x($) = (Xj , x n ) where Xj = x . <S> - fcj 

is called the marginal vector corresponding to the strategy £ for 
player I and similarly y = y(>|) = (y 1 , • • •, y ffl ) where y^, = y^rj) = R^ 
Is called the marginal vector corresponding to the strategy yj for 
player II. 

If player I chooses the strategy £ then his payoff will be at 
least the minimum component of the vector x(|). It is well known 
(cf. [7], p- 159 ) that the objective of player I is to select a strategy £ 
so as to maximize the minimum component; thus he can be assured a payment 
of at least 


<*) 


v, = max min x.($) = max min E-(£,*)) . 

1 i 3 J S ”1 5 


(We use here the fact that min x(|)>j = min Xj($) .) 

Similarly player II can play so as to be assured that the payoff 
to I is no more than 
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(5) ' v 2 « min max y ± (>j) - min max . 

The minimax theorem states that v 1 « v 2 « v (for proofs see 
[5], p. 12$, ff. and [10], p. 19). 

We say that f(£) » min Xj(£) is the minimum function for 

player I and call those | which maximize f(§) optimal strategies for I. 
Similarly we call g(>j) ** max y i (>)) the maximum function for player II 
and call those >j which 1 minimize g(Y|) optimal strategies for II. 


and call those 


f 2. A GEOMETRIC MODEL 

Let Ep he real cartesian space of dimension p and let 
be the subspace of Ep consisting of those points with last coordinate 
zero. We choose barycentric coordinates in Ep_ 1 based on some set of p 
scattered points (for instance the origin and the unit points on the first 
p-1 coordinate axes would do). A point p in Ep -1 belongs to the 
closed simplex with these points as vertices if and only if its barycentric 
coordinates c 1 , ..., c p constitute a probability vector. Thus we can 
realize S p as a closed simplex in E p _ 1 , with the probability vector $ 
represented by the point whose barycentric coordinates are | 1 , ..., £ p . 

For examples, S 2 is realized by a line segment (with some typical 
coordinates) 


(1,0) (3/MA) (1/2,1/2) (1/4,3/4) (0,1) 


and by a triangle, viz: 



Any point P in EL can be specified by the p barycentric 
coordinates ^, •••, $ p of its projection in E p-1 together with its 
final ordinary Cartesian coordinate x and we write P - (^, ...» L; x) 
or for short P - (§;x). (Here | need not be a probability vector.) We 
denote by P p the set of all points P - ($;x) in Ep for vl*Lch $ Q Sp 
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and call P p the game space of dimension p. 

Suppose that h(£) is any real valued function defined for all 
vectors § £ Sp. We can represent h(|) geometrically by the surface in 
Pp consisting of all points (§;h(|)) for £ £ S p . 

Since only P 2 and P ? can be realized pictorially, we now 
embark on a discussion of 2xn and 3xn games to motivate further alge¬ 
braic considerations- 

f THE 2x2 GAME 
Let the play matrix be 


A = 


and corresponding to £ S 2 we can find the marginals, viz: 

X 1 “ a i 1$1 + S 21 ^ 2 ' X 2 “ a i 2^1 + a 22^2 ‘ 

Geometrically, these marginals can be plotted, viz: 



The two straight lines represent the marginals as a function 
of g, i.e., - (g C,), ac 2 - (g C 2 ) . The dark line represents the 

minimum function, f(|) *= min (g Cj) of player I. The maximum of this 

minimum function is v. which occurs at the optimal solution ($?,$£)• 

1 * 

Note that S 2 is deconposed into subsets S 2 V ' and S 2 . The above 
diagram incorporates all the essential features of the game when the 
optimal strategy (|°,||) Is an interior point of S 2 - 

We illustrate in the figures below typical examples of 2 x 2 
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games including all possible ordering relationships among the elements of 
the game matrix. 











In the cases (c), (a), and (h) all strategies for I are optimal. 
In case (f) there is a subset of optimal strategies. In cases (b), (e), 
(g), and (i) the optimal strategies occur on the boundaries and thus I has 
a unique pure strategy. In all cases the set of optimal strategies forms 
a convex subset of S g . Those optimal strategies which occur at the 
intersection of two of the four lines x - x - $C 2 , *0, $ 2 - 0 

are called basic strategies. In each case the convex set generated by the 
basic strategies comprises the set of optimal strategies. Algebraically 
then, the basic strategies are the solutions of a proper system of linear 
equations. 

To find the point of intersection of the marginal lines for 
player I we solve the system: 
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a 11$1 + a 21?2 - X = 0 
a l 2$1 + a 22*2 - X - 0 




t + *2 

= 

The determinant of 

1 

the system is 


♦ (A) = 


a i1 a 21 

-1 



a i 2 a 22 

-1 


Ml 


1 2 


22 


a 21 


1 1 0 


which Is easily seen to be the sum of the elements of tlie adjoint of A. 
By Cramer's rule we have, provided 0(A) ^ 0, 


* a 22’ a 2i 

— * 
1 4><A) 


a i 1 ~ a 12 
<t>(A) 


X 


aet A 

~$TaT ' 


If we define the special matrices 

1 R = 111 ill 

then we can write the solution as 


1 


1 




adi A) 


x 


det A 

= Mat • 


By a similar analysis, the point of intersection of tlie marginals for II is 

P 

y\ (ad.i A) 1 „ det A 

1 = MtaT • x = Hat • 

In cases (b), (c), and (a) the marginal lines are parallel and 
0(A) =0. In cases (e) and (h), 0(A) ^ 0 but the point of intersection 

lies outside of the game space and does not represent a basic solution. 

In case (g) the point of intersection lies in the game space but again it 
is not a basic solution as it is not the maximum of the minimum function. 

If we now include the lines ~ 0 and £ 2 - 0 as possible 
equations we get additional points of intersection, namely (1,0; a 11 ), 
(1,0; a 21 ), (o,l; a 12 ), (o,l; a 22 ). Algebraically, then, a method of 
procedure would be to find all points of intersection (which we call criti¬ 
cal points). Those critical points which lie in the game space and lie on 
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the maximum of the minimum function represent the basic solutions. The 
entire set of optimal solutions consists of convex linear combinations of 
these basic solutions. 

We will indicate subsequently why this procedure of computing all 
critical points is not computationally economical. However, this method 
generalizes to give the results in [8], page 35, concerning the determina¬ 
tion of the basic solutions. 


$ ^. THE 2 x n GAME 
Here the play matrix is of the form 



and the marginals are Xj(£) ■ (fCj) for j " i * 2, •••, n. Again, we 
plot these marginal lines in P 2 . As a typical example let us consider the 
diagram for a 2x5 case: 



The minimum function for player I is given by the broken dark line, the 
optimal strategy is and the value of the game is v. In the 

above diagram there are nineteen critical points involved, some of which 
are obviously unimportant. Since in higher dimensional cases we cannot 
have the support of a diagram and hence cannot see which points are 
important, we want now to devise a computational procedure from purely 
algebraic considerations. In Part II we will discuss the formal details of 
the computational procedure, but for the present we use the above diagram 
to illustrate our procedure. 

Since x 1 ($) and x^(£) take on minimum values on the boundary 
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planes ^ « o and $ 2 « o we first consider the minimum function of 
these two marginal lines, viz: 



Now evaluating x^ and x^ at the critical points (1,0), and 

(0,1) we note that these lines lie above the minimum function and so may 
be discarded. But x 2 at (^,$ 2 ) ^ ies below the critical point and 
hence we must find the points of intersection of x 1 and x 2 and of x 2 
and x^. We then discard the critical point arising from the intersection 
of Xj and x^. The critical point with the largest x value then gives 
the optimal strategy and the value of the game. 

$ 5- THE 3 x n GAME 


In the 3 x n game 

a l1 a l2 •** a ln 
a 2l a 22 •*' a 2n 
a 31 a 32 a 3n 


we consider the game space P^, viz: 



( 1 , 0 , 0 ) ( 0 , 0 , 1 ) 

Each marginal function Xj($) can be represented as a plane in Py It Is 
now possible to represent geometrically I’s minimum function and to find 
the optimal strategies and value, v, of the game. A basic strategy, 
is an optimal solution such that (^°^,v) is a point of inter¬ 
section of 3 planes (we include boundary planes ^^ * o. 
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^2 » ** ^3* £3 ** ®) • 

The geometrical model for the three dimensional case can be 
constructed analogously to the two dimensional model with planes playing 
the role of straight lines. It is suggested the the reader keep this model 
in mind while reading the next part of this paper. 

PART II. THE COMPUTATIONAL PROCEDURE 
k 6. SUMMARY OP PROBLEM 


As we have seen, the goal of player I is to find those £ which 
maximize his minimum function f(£). Since the marginals x^ = are 

hyperplanes in P m , the minimum surface x = f(f) in E m is a polyhedron 
and so can be completely described by giving its vertices which are, of 
course, finite in number. We now develop a systematic computational pro¬ 
cedure for determining these vertices. Suppose the vertices are 

= (t ^ 1 ^ • y( 1 ) \ * - * - Q = x (s) ) . Then v = max x^ is the 

>(j) 


Q 1 = (r ,; ; x v 1 , ..., Qg - (V OJ i x vo; ). Then 

value of the game and the for which x^ 

strategies in the sense that the set of all optimal strategies is just the 
set of points in the smallest convex subspace of S which contains these 


v = max x v 

3 

= v are basic optimal 


maximizing $ 


(j) 


see [8], page 28, 30. It can be shown that the two 


definitions of basic strategies are equivalent, see [6], appendix. 


$ 7. THE SOLUTIONS FOR PLAYER I 


A basic component of the computational technique, to be discussed, 
will be to find the intersection of the line segment joining two points of 


r m and a hyperplane in 


m 


To this end, we introduce the following lemma. 


LEMMA. The line segment joining the two points 

x^ 


($ (1) ; x (1) ) and P, - 


rd>) in P„ 


^i ’ “ ' - *j *m 

intersects the hyperplane: | Q S m ) if ana 


,(k) Jk) 


^(k) d (k) 
i j 

i(W = «<J), 


only if d}*' d'. A; < 0 where d^*' = | vx 'C k - x 


(k) _ *(i) n v (i) 

\JL • \ V IVUWi V mf \JL - * ' “ 

C k " • In particular, if 

d^* ; ^ 0 ttien tiie P oint intersection, P, is 

unique, and given by the relation: 


_ Pj + 4 k > p .i 

d<*> - 

Proof. The line segment joining and Pj can be parametrized 
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by the relations tP 1 + (1 - t)Pj where o < t < 1 . This line segment 
will intersect the hyperplane if and only if there exists a t in the 
interval [o,1] such that 

(t ! (1) + (1 - t)| ( J } )C k - (t x (1) + (1 - t)x (J) ) = o , 

or if 


O - t)dV 


(*> = o 


If d^' = 0, then the point P^ lies In the hyperplane, 
then the point Pj lies in the hyperplane. If 
line segment lies in the hyperplane. If both d 


then the 


^ — Cl j — vy OliC.il OiiC 

and d. are different 


XXlic; OOglUOIib iiCO XII OHO • xx UUUU U.^ 0,11U u.j Oi C UXi. 

from zero and of the same sign then there is no solution of 7• 1 for 
0 < t < 1 . If, however, d* k ^ and are different from zero i 

-*■ — /i_\ j /i_\ j 


different sign (1.e., 
(7*1) given by 


,(k)J (k) 


are different from zero and of 


< 0) then there is a unique solution of 


and then the point of intersection Is 


l - t = 


-djfo p i * d i^ F : 


which conpletes the proof of the lemma. 

For coirputatlonal purposes we introduce the column vector 



and then d[ k) = P ± C^, d^. k) = P .C^. 

In computation of points it is necessary to know not only the 
coordinates of the point but also all the planes (or hyperplanes) which pass 
through the point. Let Ti^ denote the boundary plane (of P ffl ) which has 
the equation ^ = o (i = 1, 2, ...,m). The planes in question are the 
m boundary planes Tplus the n marginal planes Cj(j = 1, 2, n). 

A point in P m is determined by the intersection of m planes and we 
adopt the notation 
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P 


■ ^m' x 


P 

T 1' • * • ' T m | 


[ T 1 ,T 2 ,...,T ra 


where T 1 , ..., T m are m of the n + m planes mentioned above. We may 
later wish to add other planes to this symbol if they contain the point P 
but this will become clear in the following discussion and in the examples. 
We call P the labelled point corresponding to P. 

A "corner point" of a plane Cj is the piercing point of the 
plane and a line which is the intersection of m-l boundary planes. For 
example in the 2x2 case 


a i i 

a i 2 

a 21 

a 22 


the corner points of C 1 with the appropriate labels are 


1,0;a 11 

“cTjrT 


and P„ 


0,1 ;a 21 \ 
c i ,ir i J 


At a "corner" of P m it is clear which plane is part of the 
minimum function — namely the plane or planes which contains the row 
minima corresponding to that corner. Hence we assume the matrix A is 
written so that the columns containing the row minima have the lowest index 
since these planes will certainly occur in the minimum function. Prefer¬ 
ably, we consider those columns containing the most row minima first since 
they probably are the most important. 

The first step in the procedure is to write down the labelled 
corner points of C 1 ; i.e., 


,0;a 11 

C, ,Tt 2 ,.. 

o,i,...,0;a 21 

^1 ,c i •' ’ ,7r m 


0,0,...,1;^ j 


These m points completely determine C,. They form the Initial set of 
critical points in our computational procedure. 

Next evaluate d[ 2) - ^ 1 ^C 2 - x* 1 * - PjCg for 1 - 1, 2, .... m. 
Nov ve vant to add nev critical points to those obtained above according to 
the following rule; 
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Find the piercing point of the line segment joining P^ and 
P^ and the plane C 2 if 1 

1. di 2 * dl 2 ^ < 0, and 

i 1 ± 2 

2. the line segment joining P^ and P i is an edge of 
the minimum surface hounded Ay Tt^ , . ir and C 1 . 

This critical point is to be added to the above set and labelled 

with Co and the planes common to P.. and P, . 

1 i 1 2 

A geometrical interpretation of the above step is the following. 
Condition 2 insures that the two points lie on an edge of the minimum 
surface determined by the planes already considered in the process. Condi¬ 
tion 1 insures that C 2 is above one of the points and below the other 
point so the line between them pierces C 2 . Hence this piercing point is 
important in the construction of f (O . 

To all labelled points P i such that d^ ' = o we must add the 
plane C 2 to the label since it may be important later on to remember 
that C 2 passed through these points (e.g., in satisfying Condition 2 
above for later steps in the process). 

Next we eliminate all critical points P i with d^ 2 ^ < o since 
plane C 2 goes below them. 

Finally we add all corner points of C 2 which are relative row 
minima of the payoff matrix, e.g., those whose y coordinates satisfy 

a i2 < S i1 • 

We take account of the results of the last two operations by 
means of index sets defined as follows: let K 1 be the set of integers 
1, 2, ..., m; let be the set of integers i(l ^ i £ k 2 ) (where k 2 

is the total number of points considered in the first two stages) which are 
the indices of those points not eliminated in the first two stages. 

We now have found all the important critical points of f($) 
which arise from the first two columns. Next take the column C^ and 
repeat the above process, then C^ etc. up to C n - 

In order to avoid introduction of extraneous points which are not 
vertices we need a criterion which will tell us, at any stage, whether or 
not two vertices are adjacent (i.e., connected by an edge). A necessary 
condition at the end of the h-th stage for P.^ and Pj to be adjacent is 
that they shall have at least m-i planes of the set = 

(TT^, if c } , ..., C h ) in common. However, it may happen that certain 

planes will be dependent and then the number of common planes can be greater 
than m-l . Suppose that P^ and Pj have the subset " 

(T 1 , ..., T r ) of 2)^ as their set of common planes. Then P ^ and Pj 
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will be adjacent -if and only if no other vertex is on all of the 

planes of • 

In the practical determination of adjacent vertices the plan 
followed here is first to check for all pairs of vertices with at least 
m-1 planes in common and then to determine which of these pairs are 
actually adjacent. 

We summarize the procedure now in a minimal set of rules given 
in an inductive form. 

STEP 1: 1 . Label columns containing the row minima of A with 

lowest index. 

2. Compute the initial set of critical points con¬ 
sisting of the m corner points of C.,, and 
initial index set K 1 = (1, 2, ..., m) . 

STEP j+1 : Assume the j^ step (j = 1, 2, ..., n - 1) to be 
completed with critical points P 1 , ..., P k # and index set Kj obtained. 

1. For each critical point P., = x^ ) . 1 G K 

M+1 1 ^ J 

compute ' - P i Cj +1 . 

2. Add the symbol Cj +1 to the label of all points 

such that = o. 

3- Find the piercing point of the line between P, 

1 i 

and P, and the plane C. . if 
•J-g J +1 

(a) a<J +1 d<j +1 < o 

(b) m-1 of the planes in each of the labelled 

points P. and P. are the same, and the 
2 

vertices P. and P, are adjacent. 

X 1 ± 2 

This point is to be aaded to the set of criti¬ 
cal points and the planes in its symbol are the 
planes which the two points above have in common 
together with Cj +1 . 

Add to the set of critical points all corner points 
of Cj +1 which are relative row minima, i.e., whose 
x values satisfy 

a i,j+l ^ min (a ir a i2 a lj 5 * 

5 • Eliminate all critical points P ^ with d| t, ' +1 ^ < 0. 
6. On the basis of rules 3, k, and 5 compute the index 
set Kj +1 from the set Ky 

At the conclusion of n such steps a finite set of critical 
points which completely describe f($) is obtained. 



THE DOUBLE DESCRIPTION METHOD 


65 


i 8. EXAMPLE 

The computational technique for the game 
|1 3 2 13/5 


2 

0 5/2 1 

2 1 8/5 


10/3 

1/2 

1 


is given in Table I. 


Step 1 


Step 2 


Steps 3,4 


Step 5 


p 

5 

X 

C , 

C 2 

C 5 c 4 

C 5 ’ 

2 

3 

d 2 

d 3 

d“ 

d 5 

1 

1 0 

0 

1 

X 




X 

X 

2 

1 

8/5 

7/3 

2 

0 1 

0 

2 

X 



X 


X 

-2 




3 

0 0 

1 

3 

X 



X 

X 


-1 




4 

1/2 1/2 

0 

3/2 

X 

X 




X 


3/4 

3/10 

5/12 

5 

1/3 0 

2/3 

7/3 

X 

X 



X 



-1 



6 

0 0 

1 

2 


X 


X 

X 



-1 



7 

0 1 

0 

0 


X 


X 


X 


5/2 

1 

1/2 

8 

o 2/7 5/7 

10/7 


X 

X X 

X 





0 

-4/7 

9 

2/3 0 

1/3 

5/3 

X 


X 


X 




3/5 

8/9 

1 0 

5/7 2/7 2/7 

13/7 

X 

X 

X X 

X 





0 

0 

11 

0 0 

1 

1 



X 

X 

X 




3/5 

0 

12 

0 2/3 1/3 

2/3 


X 


X X 





TABLE I 


STEP 1. Relative to column C 1 we get points ? ]f ? 2 and P^ 
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together with the bookkeeping symbols denoted by x's In the appropriate 
columns. 

STEP 2 . Pill in column d^ with entries d^ 2 ^ - P^Cg for 

i « 1 , 2 , 3- Compute piercing points P^ and P^ by formula given in 
Lemma. Label appropriate planes in bookkeeping section. Add the corner 
points P 6 and P^. Strike out P g and P^ so that Kg - (1, 4, 5 , 6 , 7 ). 

STEP 3. Pill in column d^ with entries * £ Kg* 

Compute piercing points Pg, P^, P 1Q . Label appropriate planes in book¬ 
keeping section. Add corner point P n - Strike out P^ and Pg so that 
K 3 - ( 1 , 4, 7 , 8, 9 , 10 , 11 }. 

STEP l*. Pill in columns d^ with entries d$^ * P..CL, i £ L. 

v 1 1 4 ■> 

Since d^ 1 > 0 for all i £ there are no new points. Add C^ to 

labelled points Pg and P 1Q . Now K^ -* K^. 

STEP 5 . Pill in columns d^ with entries d| 5 ^ * 1 ^ K 4* 

Compute piercing point P 12 and delete point Pg. Add C^ to labelled 
points P 1Q and P n » 

The value of the game is given by P 1Q . The optimal strategy for 
player I is (3/7, 2 / 7 , 2 / 7 ) yielding a value of 13/7- Planes C 1 , C 2 , 

Cy C^, and C^ all pass through this point. 

\ 9 • THE SOLUTION FOR PLAYER II 

To obtain the entire minimum function for player II it is neces¬ 
sary to take the negative transpose of A and repeat the process as 
described above. However, If one Is only interested in obtaining all basic 
solutions for player II then once the basic solutions for player I have 
been determined the solution for player II Is (possibly) made somewhat 
easier. If for any basic solution |° of I the marginal $°Cj is greater 
than v, then eliminate the column Cj from A. After all such elimina¬ 
tions have been made call the matrix so obtained B. The columns of B 
are the totality of all non-boundary planes which are common to the symbols 
of all basic points of f (|). Suppose that B is an m by p matrix 
where p < n. The solutions of the game with B as payoff matrix are the 
same as those with A as payoff matrix, since II will not play with 
positive probability any column of A which has marginal > v for any 
basic solution of I. 

To find the solution for player II it is now only necessary to 
take the negative transpose of B and solve the resulting game according 
to the process described above. The basic solutions for the game with A 
are then obtained by extending the basic solutions for the game with B to 
n-dimensional vectors by putting O's in the n-p places corresponding to 
columns eliminated according to the paragraph above. 
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The minimum function for player II for the example of section 8 
is discussed in [6], page 34 . There are three basic strategies for 
player II, namely (7/21, 4 / 21 , 10/21, 0, 0), ( 3 / 7 , 0, 5 / 14 , 0, 3 / 14 ), and 

(21/63, 0, 22/63, 20/63, 0). 

PART III. GENERAL INEQUALITIES AND SECOND VARIANT OF THE 
COMPUTATIONAL PROCEDURE 

4 lO. ROUGH PROCEDURE 

Let £ a j k x k ) °» j = l , ..., h; k ■ 1 , .. ., n; be a system 
of h inequalities in n unknowns. Suppose that the general solution of 
the system formed by the first h - 1 inequalities is given by 
x k = £P kr V witl1 fixed P kl , taking on all non-negative values. 

Then the h~ tb inequality will determine a half-space (or the whole space) 
both In x-space and A-space. Putting b 1 = Sa^p^, the common part of 
the half space Sb 1 A 1 > 0 and of the positive A-orthant will be the convex 

■A* -1* ^ ikU 

cone generated by the rays from 0 toward e^ (e^ denoting the l~ tn 

unit vector) for every 1 with b n > 0, and ( |b n |e n + lb-, |e-, ) for 

1 - ± 2 ±1 ± 1 ± 2 

every 1 1 and 1 2 with b^ b-^ <0. Denoting p kl for b-^ > 0 by 

q km’ m “ m(1) " 1# •••» s ’ 8X1(1 p kl 1 1 b l 2 1 + p kl 2 ’ b i I for b i b i ^ ° 

b y q^, m = m(l 1# 1 2 ) » s + 1, t, the complete solution of the h 

inequalities will be given by x k = 2^^, % > °- 

$ 11 . A GEOMETRIC INTERPRETATION. REDUCTION TO ESSENTIALS 

The parametric solution just established means that the solutions 
occupy a convex polyhedral cone in n-space with the origin as vertex. The 
induction step corresponds to finding the subcone cut off by an additional 
hyperplane through 0. Some basic rays are the same as before this step; 
others are obtained by joining two rays on each side of the hyperplane by 
a plane and cutting this plane with the hyperplane. It is not supposed 
that the base before this step contains a minimal number of rays, and even 
if this is the case the use of all pairs of rays as indicated is likely to 
introduce many superfluous rays in the new base. It Is clearly desirable — 
and for numerical computations even imperative — to have a shortest des¬ 
cription of the polyhedral cone and to stay with it during the whole 
procedure. 

First consider a pointed polyhedral cone (that is, a cone not 
containing a straight line, or equivalently a cone with a unique vertex) in 
n-dimensional space and not in a lower-dimensional space. Here a concise 
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description consists of an enumeration of the extremal rays, that is, those 
rays which are not between any two rays of the cone, and of the hyperplanes 
containing the (n-1)-dimensional faces of the cone. These extremal rays 
and hyperplanes are uniquely determined by the cone, and the double and 
self-dual description consisting of their coordinates and coefficients, 
respectively, furnishes much of the useful information needed to determine, 
for instance, maximizing rays or hyperplanes, the dual cone, the intersec¬ 
tion and convex hull of two cones, the extension of the cone by an addition 
al ray, and dually, as in the above induction step, the common part of the 
cone and a halfspace. 

If the cone while still n-dimensional contains a maximal linear 
variety, say of d dimensions, the description will be the same as far as 
hyperplanes are concerned but the rays indicated will fall into two subsets 
the central part and the extremal part . The central part describing the 
linear variety will consist of d + l rays a Q , a 1 , ..., a d or perhaps 
more conveniently of d pairs of opposite rays a 1 , -a 1 , ..., a d , -a^. 

The extremal part will contain one ray for each (d + l)-dimensional face 
of the cone. Every ray of this kind is only determined modulo an arbitrary 
vector of the d-dimensional variety of vertices. 

If the cone has less than n, say 1 , dimensions this will not 
affect the description by rays. But now the hyperplanes will fall into a 
central part and an extremal part. The central part (n -1 hyperplanes) 
describes the smallest linear variety containing the cone. Every highest- 
dimensional face within this variety is singled out by one hyperplane in 
the extreme part. 

The full double description scheme at every stage looks like 


this: 

C 

D where A, B, C, D, M, and the 0‘s are matrices 

A 

0 

0 

B 

0 

M 


Each row of A contains the coordinates of a ray of the central part, 
while the rows of B give the rays of the extremal part. Every column 
of C consists of the coefficients of a hyperplane of the central part, 
while D is in the same way composed from those belonging to the extremal 
part. In the intersection of each row of A or B and each column of C 
or D stands the scalar product of both, which is always non-negative. 

A and C consist of those rows and columns respectively for which all 
scalar products in which they enter are zero, since the rays of A lie in 
all hypejjplanes, and the hyperplanes of C contain all rays. Thus M has 
no zero row or column. 

Two rows of B correspond to adjacent (d + l)-dimensional faces 
of the cone If and only if the entire set of columns of D for which both 
give zero product does not simultaneously give zero products for any other 
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row of B (cf. page 63) • In fact two faces of lowest dimension are 
adjacent if and only if the dimension of the face joining them exceeds 
their dimension by one unit only, and if and only if this joining face con¬ 
tains only the two given faces. 

To reduce the case of inhomogeneous inequalities to the above 
scheme, homogenize by writing an additional unknown % beside the con¬ 
stants and adding the inequality £ > 0. The points with $ = 0 lie in 
the hyperplane at infinity. 

Now suppose that a full double description has been obtained at 
a certain stage, and a new step is to be taken corresponding to a hyper¬ 
plane H. We write the coefficients of H as an additional column next 
to C and D and compute the inner products with the rows of A and B. 
If the products involving H are all non-negative, then the cone defined 
by H and the hyperplanes of C and D is the same as the cone defined 
by C and D above, which by supposition is fully described. Hence H 
is superfluous (it either gives no face at all or a face already indicated) 
and should be omitted. 

Secondly, if the products involving H and rows of A are all 
zero, while there exist rows of B for which the product is negative, each 
such row should be thrown out*. However, before throwing a row out it 
should be combined with each row of B corresponding to an adjacent face, 
as explained before, and giving a positive product. By combining we mean 
determining the intersection ray of the plane corresponding to the two rows 
and of H and writing the row obtained as an additional row to B- The 
determination can be effected by the formula p kl | b 1 | + p kl I b^ | of 

Section 10, or as in the computing instruction below. 

Finally we have to consiaer the case where not all products of 
rows of A Involving H vanish. We choose as normal form of A a des¬ 
cription by d pairs of opposite vectors; hence the product with H is 
positive for a certain row a of A (if there are several such rows 
choose one). Then one has to: 1) delete a and -a and adjoin a to B; 
2) delete every row a* ^ a of A giving a positive product while re¬ 
placing -a* by its "combination" defined at, before with a and by the 
negative of that combination; 3 ) replace every row of B giving a negative 
or positive product by its combination with a or -a, respectively. 

^ 12. SPECIAL CASE: x = 0 

If the inequalities x 1 =0, ..., x n = 0 occur in the given 
system, as for Instance in the game case treated In Parts I and II, these 
inequalities can be taken first and since their solution is the positive 
orthant, d is already zero, the central part A is void and the last- 
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mentioned possibility in the procedure of Section 11 does not occur. If 
we suppose that the given system is non-degenerate in the sense that no 
n + 1 of the (inhomogeneous) linear functions vanish at the same point, 
which is always the case after a small change of the coefficients, then 
also the condition for adjacency takes on an especially simple form and a 
computing instruction for such a system would be as given below. 

The computation at the end (see Tables II and III) concerns a 
submatrix of the diet-matrix in [ 9 ] • In this example the matrices A and 
C of the schematic diagram above are absent. The rows Li, ..., L n 
(L i represents the i-th row below L), corresponding to the inequali¬ 
ties x 1 >0, ..., x n > o, are the Initial entries in the matrix D which 
is written as rows rather than columns for convenience in tabulation. The 
additional rows Ln+l, ...,Ln+h of D, corresponding to the other 
given inequalities, are used successively in the computation. The entries 
in L n + h + 1 are the coefficients of the function to be minimized. 
Column 0 of the table contains the constants of the linear Inequalities 
and, below P, the homogenizing coordinates of the vertices. Columns 1 
through 6 contain the coefficients of the linear inequalities and of the 
function to be minimized and the coordinates of the vertices. 

The rows Pi, ..., P n + 1 (Pi means the i-th row under P) 
constitute the matrix B at the beginning of the computation. During the 
computation rows P n + 2 , ... are incorporated in B, while some P-rows 
may cease to belong to B. The scalar products in the matrix M used in 
the computat ions appear in columns n + 1, ..., n + h + 1 . The arrows 
indicate the correspondence between the L-rows and these latter columns. 
Columns - 3 , -2, and -1 are used to record labels and side calculations. 

The final polyhedron is described by B in its final form, 
namely, it has vertices PI to P 35 except P 1, P 8, P 10, P n, 

P 12, P 20; and by D in its final form, namely, by the five-dimensional 
sides L 0 to L 10 except L 8, where L 0 denotes the hyperplane at 
Infinity. 

Since row P 1 9 gives the smallest value in column 11, it is 
the only solution of the minimization problem. 

ABBREVIATIONS. L 3 means the third row below L. 

P 3 means the third row below P. 

P 3 7 means the number in row P 3 and column 7- 

ORDER OF STEPS. Perform step 1 A, then all steps 1 B, then 
step 2 A, then steps 2 B, step 3 A, ..., until step h B. 

STEP s A. Compute entries P k n+s in the n+s th column as 

far down as possible by formula t, except that if Pk0=0 write 

P k n+s - «; and omit P k n+s If P k n+h+1 is an x. 

STEP s B. For every k for which P k n+s < o and for every 1 
for which P 1 n+s >0 or PI n+s «■«#, and for which P k and P 1 
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nan 

D 

n 

2 

... n 

n+1 

... n+h 

n+h+1 

L 








1 

0 

1 

0 

0 




2 

0 

0 

1 

0 




n 

0 

0 

0 

1 




n+1 





~N 





given 



•, 


n+h 






'N 


n+h+1 

0 

1 

1 

1 



■'N 

P 








1 

1 

0 

0 

0 




2 

0 

i 

0 

0 




n+1 

0 

0 

0 

1 




n+2 








n +3 



to be computed 




TABLE II 


have n -1 common zeros perform substep n+s k 1 . When through all sub¬ 
steps n+s k 1 belonging to the same P k n+s < 0 (there may be- none at 

all), make an x in P k n+h +1 and In all free places in columns n +1 

to n+h+1 in row P k. 

SUBSTEP n+s k 1 . Start a new row by its number, say m, in 
column - 4 . Wrtie k in column - 5 , 1 in column -2, and 
1000 |P k n+s|/(|P k n+s| + P 1 n+s) in column -1 (to be omitted if 
P 1 n+s = <*>); write 1000 in column o (n.b., we multiply our computa¬ 
tions by 1000 to avoid decimals); and write o in each of the n-t col¬ 
umns in which P k and P 1 have common zeros and in column n+s. The 
remaining P m j, j » 1, ..., n, compute by formula 2, except that if 
P 1 n+s = ®, use formula 3. (Other entries in row P m coming before col¬ 
umn n+s are unnecessary for subsequent calculation and are marked by an x. 

FORMULA 1. P k n+s - (P k 0 . L n+s 0) + (P k 1 . L n+s 1) 

+ ... + (P k n . L n+s n). 

FORMULA 2. Pmj»Pkj + 1/1000[P m (-1) (P 1 j - P k j) ]. 

FORMULA 3 . P m j - 1000 |L n+s 0| / L n+s j unless L n+s j * 0 

in which case write P m j ** 1000 |L n+s 0|. 
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SOLUTIONS OF CONVEX GAMES AS FIXED-POINTS 1 
M. Dresher and S. Karlin 

$ 1 . INTRODUCTION 

In a game with a finite number of pure strategies the choice of 
a mixed strategy is equivalent to the selection of a point in a simplex. 

If the strategies are constrained in any way, then the choice is no longer 
made from a simplex but from an arbitrary convex set. Many infinite games, 
e.g., polynomial and polynomial-like, are essentially finite games over 
general convex sets since the choosing of a mixed strategy is equivalent to 
choosing a point in a finite dimensional convex set. 

In this paper we study games played over arbitrary convex sets. 
Interpreting the solutions of a game as the fixed-points in a continuous 
mapping, we obtain some general results on the dimensionality and continui¬ 
ty of solutions. Dimensional relationships for games played over simplices 
were first derived in [l] and [5]. Some dimensional and continuity rela¬ 
tionships for polynomial-like games were first obtained in [2). The gen¬ 
eral convex game treated here can be formulated as a polynomial-like game 
by spanning the convex set with a Peano space-filling curve. However, the 
complicated nature of such a curve makes this formulation impractical for 
theoretical and computational purposes. We also describe a method of com¬ 
puting the solutions by mapping one convex set onto another. The method is 
applicable to both finite games and infinite games with polynomial or 
polynomial-like payoffs. 


4 2. CONVEX GAMES 

We define a finite dimensional convex game as follows: Player I 
chooses a point r - (r 1 , i» 2 , ..., r m ) from a convex set R lying in 
Euclidean m-space. Player II chooses a point s * (s,, s 2 , ..., s n ) from 
a convex set S in Euclidean n-space. R and S are bounded and closed. 
The payoff from Player II to Player I Is given by a bilinear form 


1 The preparation of this paper was sponsored by The RAND Corporation. 
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( 1 ) A(r,s) - 2 )^, + f Q (r) - JJiH Sl( 3 > r i + 8 o (s) “ S r l a lj s j 

where f(r) and g(s) are linear functions of r and s, respectively. 

If Player I has m pure strategies and Player II has n pure 
strategies, then R and S are (m - 1 )-dimensional and (n - 1 )-dimen¬ 
sional simplices, respectively, and A(r,s) is the mixed strategy payoff 
to Player I. However, if a game has a finite number of pure strategies and 
the mixed strategies are subject to some finite number of linear constraints 
then the sets R and S are polyhedral convex sets. If a game is con¬ 
tinuous and the payoff is polynomial-like, i.e., the payoff to Player I 
from Player II if they choose pure strategies x and y, respectively, 
is given by 


M(x,y) - a^xja^y) 

where r^ and Sj are continuous functions, then R is the convex set 
spanned by the curve 

r l “ r i(x)» 0 < X < 1 , i = l, 2 , ..., m, 

traced out in m dimensions, and S is the convex set spanned by the curve 
s j = S j (y *' 0 < y < 1 > j = 1 , 2 , ..., n, 

traced out in n dimensions [ 2 ]. The payoff A(r,s) is given by ( 1 ). 

{ 3 • SOLUTIONS OF CONVEX GAMES 

The existence of optimal strategies r°,s° and a game value v, 

such that 

( 2 ) max A(r,s°) = min A(r°,s) = v 

rGR sGS 

can be established in two fundamental ways. We may use properties of con¬ 
vex sets, specifically the result that two non-overlapping convex sets can 
be separated by a hyperplane. It also follows from the Kakutani fixed-point 
theorem [fc]. 

The optimal strategies (one set for each player), or solutions 
are the generalized fixed-points in the upper semicontinuous mapping de¬ 
scribed as follows: Let r° G R. Define the image of r° on S to be the 

set of points S(r°) C. S where min A(r°,s) is assumed.. S(r°), which is 

sGS 

the intersection of a hyperplane with the boundary of S or coincides with 
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S, is a convex set. Let s° Q S and let the image of s° on R be the 

set of points R(s°) C R where max A(r,s°) is assumed. If r° t R(s°) 

oo oo ' 

and s Q S(r ), then r ,s satisfies ( 2 ) and is therefore a solution of 

the game. Further, since r° is an image of s° and s° is an image of 

r°, r° and s° are fixed points in R and S, respectively. It is 

clear that if R°,S° are the sets of optimal strategies of the two players 

then every point of R° is an image of every point of S° and every point 

of S° is an image of every point of R°. 

We cap also formulate the solutions as fixed-points of the 

point-set mapping P which takes a point (r,s) in the product space 

R®S into the non-void set (R(s),S(r)) = F(r,s) in R(x)S, where R(s) 

and S(r) are defined above. 

CONTINUITY OF SOLUTIONS 

To develop the theory of convex games, we first study the solu¬ 
tions for continuity. The following theorem, first proven in [ 2 ], is 
repeateo for completeness. 

THEOREM 1 . The solution of a convex game is a 
lower semi-ccntinuous function of the payoff. 

PROOF. Let G be an open set containing the optimal strategies 
R° of player I in the game with payoff A = A(r,s). Suppose each element 

of A is perturbed by at most £, let A^ denote the resulting payoff 

and R^ denote the set of optimal strangles of player I. We assert that, 
for a sufficiently small £, R g is in G- For, let us assume the contrary 
Then there exists a sequence l£ n ) tending to zero with a corresponding 

sequence of payoffs A^ such that each R t is not contained in G. Let 
fc n ri 

r be in R t but not in G. Since R is compact we may suppose that 
n * n 

r n tends to r as n —» oo, where r is not in G but in R. Furtner, 
it is readily verified that a limit point of optimal strategies for the 

payoffs A £ is an optimal strategy for the payoff A. But r is not in 

n o 

G and hence not in R and so we arrive at a contradiction. 

By an identical argument one can show that if the strategy spaces 
R n converge to R, then the sets of solutions are lower semi-continuous. 

A set of spaces R n is said to converge to R if every point of R is a 
limit point of points of R n and there exist no other limit points of 
points of R n . 
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{ 5 • GAMES WITH UNIQUE SOLUTIONS 

In this section we derive a dimensional relationship for games 
with unique solutions. It is shown that the relevant property of the 
polyhedral face containing the optimal strategy is the dimension of the 
face rather than the number of vertices. 

Let r°,s° be the unique solution of the game with payoff 
A(r,s) over the strategy space (R,S). Assume that R and S are poly¬ 
hedral convex sets. Let r° be interior to a k-dimensional face R° of 
R, and s° be interior to an 1 -dimensional face S° of S. R° and S° 
are polyhedral faces. Since s° is optimal, it maps onto some maximal 
fape R* ^R 0 . Similarly, r° maps onto some maximal face S* => s °* 

LEMMA 1 . The game with payoff A(r,s) over the 
reduced strategy spaces (R ,S ) has the unique solu¬ 
tion r°,s°. 

PROOF. Since r° maps onto S , 2 s °S s ° and s ° maps onto 
R 1 2 r ° S r °> follows that r°,s° is a solution of the game over the 
strategy space (R ,S ). To show it is unique, let us assume that s £ S 

i 

is another optimal strategy for Player II. Then s maps onto some face 
containing R°. Let s = fcs' + (1 - a)s° be a solution close to s°, .and 
therefore maps onto a face containing R°. Now for the original game over 
(R,S) we defined r' as the maximal face upon which s° maps. Hence a 
point 5 sufficiently close to s° will map into some part of r' con¬ 
taining r°. Therefore s is another solution of the full game, which 
contradicts the uniqueness assumption. 

We may now confine ourselves to the reduced polyhedral game over 
(R*,s'). In this game r° is interior to R°, and r° maps onto S* 
Similarly, s° is interior to S° and s° maps onto R*. 

LEMMA 2 . If r°,s° is the unique solution of the 
polyhedral game (R ,S ), then 

R° - R* and S° - s'. 

PROOF. Suppose s° is on the boundary of S', or S° C S'. 
Consider a sequence S n of polyhedra interior to S* excluding S° which 
expand out to all of S as n increases. We can construct S n by using 
any inner point c of S and taking the set of all points on the segment 


Ac + (1 - A)x 


0 £ A < 1 - *n 
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t 

and x any point of S . 

Consider the game over the spaces (R ,S n ). Let (X n , Y n ) de¬ 
note the solutions to this game. Then from the lower semi-continuity of 
the solutions it follows that every sequence of solutions s n tends to 
s°. Now since r° is interior to R°, then for n sufficiently large 
the solutions r n lie interior to a polyhedron having R° as a face. 
Therefore, for n large, s n maps into a polyhedron containing R°. But 
r° maps into all of S*, it follows that (r°,s ) is a solution of the 

i 0 

game over (R ,S n ). It also follows that (r ,s n ) is a solution of the 
game over (R^S*). This contradicts the hypothesis, since s n is in¬ 
terior to s'. Therefore S* * S°, and similarly R* = R°. 

REMARK. Using a similar argument, we can generalize Lemma 2 to 
games with non-unique solutions. Let R° be the smallest polyhedral face 
containing the set of solutions of Player I. Now every optimal strategy 

of Player II will map onto some polyhedral face of R; some of the optimal 

o * 

strategies will map onto R . Let R be the maximal intersection of 
these polyhedral faces. Then, by an argument Identical to above, it can be 
readily shown that r' = R°. Similarly, if S° is the smallest polyhedral 

i 

face containing the optimal strategies of Player II, and S Is the Inter¬ 
section of all polyhedral faces Into which are mapped Player I‘s optimal 

' o 

strategies, then S = S . Again, we may confine ourselves to the reduced 
game over the space (R°,S°). 

THEOREM 2 . If a polyhedral game has a unique solu¬ 
tion, then the two optimal strategies lie in polyhedra 
of the same dimension. 

PROOF. Since r° maps Into an 1 -dlmensional polyhedron in S, 
we must have 


fj(r) =o j = l, 2 , ..., 1 , 

or some 1 linear relations must be satisfied. These relations determine 
a manifold of points in R mapping onto S° and having dimension, at 
least, m - 1 . Now the manifold and the k-dimenslonal polyhedron have only 
r° in common, otherwise the uniqueness of the solution would be contra¬ 
dicted. Therefore, 


m - 1 + k £ m 


or 


k< 1 . 
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Similarly w© can show 1 < k, and therefore k « 1 . 

♦ 6. GAMES WITH MANY SOLUTIONS 

We can reduce the general case of polyhedral games with many 
solutions to the special case of games with unique solutions. Suppose X, 
the set of optimal strategies of Player I, is k-dimensional and is in¬ 
terior to a polyhedron, R°, which is u-diraenslonal. Suppose Y, the set 
of optimal strategies^of Player II, is jl- dimensional and is interior to a 
polyhedron, S°, which is v-dimensional. 

THEOREM 3. For any polyhedral game, the set of 
solutions and their containing polyhedra satisfy the 
dimensional relationship 

u - k = v - 1. 

PROOF. We have shown that X maps onto S° and Y maps onto 
R°. Consider the reauced game over the spaces R°, S°. The payoff now 
becomes 


A(r,s) = l'j(r)Sj + l’ 0 (r) - 2 ) 1.-1 £l (s)r l + 6 0 ( s )- 

The common zeros of f,(r), f 2 (r), —, f(r) In R° correspond to the 
optimal strategies of Player I and the common zeros of g^s), g 2 (s), ..., 
g u (s) In S° correspond to the optimal strategies of Player II. 

Form the factor space of E u / X u , where E u is the Euclidean 
space containing R° anc X u is the linear extension of X in E u . By 
taking a cross section T in E u perpendicular to the manifold X, the 
polyhedron R° becomes a now polyhedron in T. Since X was interior 
to R°, then X becomes a unique interior point r° of T. In a similar 

way we construct the factor space E v / Y v , and by taking a cross section, 

the polyhedron S° becomes a polyhedron U ana Y becomes a unique in¬ 
terior point s°. We obtain the induced mappings of f 1 , f 2 , ..., f v 
and gp g 2 , ..., g u on T to U, which are well defined. 

For this mapping it is clear that r°, s° are optimal strategies, 
as X u and Y v constitute the zeros of f^ and gj, respectively. They 
are also unique, since any other strategy r' of Player I must cover all 
of T and hence must be a common zero of the induced mappings f 1 , 

f 2 , ..., f y . In terras of E u , this implies that r' belongs to the 

coset X u . From Theorem 2 it follows that 

dim T = dim U 
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or 


u - k - v - 1 . 

$ 7 • UNIQUENESS OP SOLUTION AND PERTURBATION OP PAYOFF 

We shall demonstrate tiiat if a finite polyhedral game has a 
unique solution, then for any sufficiently small change in the payoff the 
solution remains unique. 

Let the solution r°,s° of a polyhedral game be interior to 
a k and 1 dimensional face R° and S°, respectively. We have proven 
that k «= 1 . Let T be the manifold of all points in R mapping into 
S°. Then T is defined by 1 linear relations, say 

Sl=l b lj r i = °« j = 1 , 2 , 1 

where bjj is a linear function of the matrix A. Let the dimension of 
T be w, then 

w > m - 1 . 

Since T ana R° intersect in a unique point r°, we have 

m>v/ + k = w + l. 


and thus 


w = m - 1 . 

The last relationship implies that the matrix (b^) has 
rank. If the payoff is perturbed by a sufficiently small amount, the di¬ 
mension of T will not change — the rank is preserved. We can also 
preserve the rank of the intersection of the manifold T and R°. There¬ 
fore we can obtain an (m - 1 )-dimensional manifold which intersects R° 

t i 

in a unique point r . In a similar way we can obtain a unique point s 
in S . Since r and s are unique points of intersections, it follows 

i i 

that r ,s is the unique solution of the game with the perturbed payoff. 

If the game is a general convex game, not necessarily polyhedral, 
then the uniqueness of a solution is no longer preserved under small per- 

p 

turbations. For example, in the game with payoff M(x,y) = xy - x , both 
players have unique optimal strategies lying on the boundaries of their 
respective spaces. If the payoff is perturbed to xy - x 2 + tx, the 
uniqueness is destroyed. However, if both players possess interior unique 
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optimal strategies, then the planes fj(r) - o Intersect In a unique in¬ 
terior point and the planes g^s) ** o also intersect in a unique interior 
point, and small perturbations of the payoff preserving this intersection 
property will preserve the uniqueness as well. 

( 8 . INTERIOR AND "IDENTICALLY v 1 ' SOLUTIONS 

We can interpret geometrically two general types of solutions: ' 

1 . Solutions interior to R and S. 

2 . Strategies which yield identically v to a 
player independent of strategies of the other 
player. 

Let r° be an interior optimal strategy of Player I and s° 
some optimal strategy of Player II. Then s° maps onto a set R(s°) 
containing no interior point of R unless g i (s°) 558 o for all i. There¬ 
fore every optimal strategy of Player II Is on the intersection of the 
planes g 1 (s) = o, and thereby yields identically v. The interior solu¬ 
tion, r°, of Player I need not have any special position relative to the 
planes fj(r) ** 0 • However, an optimal strategy r° yields identically v 
if and only If it lies on the common portion of all the planes fj(r) * 0 . 

$ 9 • SYMMETRIZING A CONVEX GAME 

A finite convex game can be symmetrized in a manner similar to 
the simplex game. Let the payoff be represented by 

(Ar,s) = £.,-1 ( XlZ a lj r l) 3 j- 


Define 


p(r 0 ,s 0 ) - max (Ar,s n ) - min (Ar n ,s). 

0 0 r£R 0 sGS 0 

It can be verified that p(r 0 ,s Q ) > 0 , for all r 0 ,s Q and p(r 0 ,s Q ) - o 
if and only if (r 0 ,s 0 ) is a solution of the game. Furthermore, 


p(r 0 ,s 0 ) » max (Ar,s Q ) + max (r 0 ,-A's) 
r€R sGS 

- max [(Ar,s 0 ) + (r n ,-A's)]. 
r€R 0 0 

sGS „ 


Form the product space E h+m - E n ®E m and the product convex 
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set HgB. Consider the linear operator IA,-a') (r,s) defined over E n+ffl . 
The payoff over the product space becomes 

(IA,-a') lr,s), (s 0 ,r 0 )) - (Ar,s Q ) + (r 0 ,-A's). 

This is a symmetric game in which Player I picks (r,s) and Player II 
picks (s,r), each from the space RgS. The solutions of this symmetric 
game are those (r» 0 ,s Q ) for which p(r 0 ,s Q ) = o. 

Every finite convex game can be symmetrized to a new convex game 
in (n + m)-dimensional space whose payoff matrix is given by 



and where both players choose points from the product set RgB. If R 
and S are both simplices, then R 0 S Is no longer a simplex. In order 
to play on a simplex set it is necessary to add an extra dimension. 

$ 10 . COMPUTATION 

We can compute the set of solutions R°,S° by an orderly exami¬ 
nation of the spaces R and S for fixed-points in a continuous mapping. 
The method consists of dividing the space R into a finite number of con¬ 
vex subsets R 1 , R 2# ..., R^ by means of the hyperplanes fj(r) « o, 
j - 1 , 2 , ..., n, and the boundaries of S, and similarly dividing the 
space S into a finite number of convex subsets S 1 , S 2 , ..., S^ by means 
of the hyperplanes g^s) = 0 , i = 1 , 2 , ..., m, and the boundaries of R. 
The division of R is such that each of its subsets R^ maps onto some 
maximal boundary of S and each of the subsets Sj maps onto some maximal 
boundary of R. The subsets, Rwill overlap, but their union is the 
full strategy space, R. From the previous discussion, It follows that 
R°,S° are the fixed-points in the mappings of R 1 , R g , ..., R^ onto S 
and S 1 , S 2 , ..., onto R. Further, R° = R^ for some i, and 
S° *= Sj for some j. 

We illustrate the method by two examples — first, a game with a 
finite number of pure strategies, and second, a game with a continuum of 
strategies with a polynomial payoff function. 

EXAMPLE 1 . FINITE GAME WITH CONSTRAINTS 

Let the payoff corresponding to the pure strategies be defined 
by the matrix 
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/ 3 39 30 \ 

I 33 9 0 

\28 4 25 / 

We wish to determine the optimal strategies if the mixed strategies are 
subject to the following additional constraints: 

1 < 10x i < 8 1 < 10 y 2 < 2 °yi 

1 < 20x 2 < 10 1 < 6 y 3 - 

18 - ItOx, < 15Xj. 

Prom the constraints it is evident that R is a pentagon and S is a 
triangle. We may write the payoff as follows: 

A(x,y) » (I0x 2 - I0x 1 + Oy 1 + (iox 2 + I0x ] - 7)y 2 + j(5x 1 - 25x 2 + 25 ) 

- (-lOy, + 10y 2 + |)x, + (lOy, + I0y 2 - l^)x 2 + (y, - 7y 2 + 

- P,y, + P 2 y 2 + P 5 » q,x, + q 2 x 2 + q ? . 

We now divide'the spaces R and S Into the following convex 

sets: 

R, (p, >°» P 2 > °)» R 2 (P, > °» P 2 < °)» R 3 (p 1 < °» P 2 > °). 

R^(p, <o» P 2 < °)» R 5 (p, = P 2 < °)> Rg(Pi = p 2 = 0 ). 

S, (q, > 0, q 2 < 0), S 2 (q, < o, q 2 > 0), S ? (q 1 - 0, q 2 < 0), 

S 4 (q, - q 2 - 0). 


Some of these sets may be void, in which case they will not 

appear in the later mappings. Some of the sets overlap. Mapping each R^ 

into S and each S. into R, we have 
J 

R,—*(Sj) —* (Rj)» R 2 —>(S,)—>(R 3 ), R 3 —HS 2 ) —+(R 2 ) 

R^’ ■■ (Sg) ■*"" (Rg) » R 5 - > S^ 1,1 R^ • 

where (Sj) represents a point in S 1 and (R^) is a point in R^. 
Therefore R° - R^ and S° - S^, or the optimal strategies are given by 
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x = — JL< x < JL 

A 1 5 * 20 « A 2 _ 10 * 


1 


1 


y l “2* y 2 5 # 

The value of the game is v - 1 9•5• 

EXAMPLE 2. INFINITE GAME WITH POLYNOMIAL PAYOFF 


Let the pure strategy payoff be given by 

M(x,y) « 21x + I8x 2 - - l6y - }6xy - 9x 2 y + l8x 5 y + 60 y 2 - 36 y 5 

where 0 < x < 1 , 0 < y < 1 . If F(x) and G(y) are mixed strategies of 
the two players, define 


r i = Jo x 1 dF(x) 

i - 

3 j “ Jo y jdG <y> 

j = 


The mixed strategy payoff becomes 

A(r,s) = 21r 1 + l8r 2 - 2kv^ - l6s ] - 36 r 1 s 1 - 9r ? s 1 + l8r^s 1 + 6os 2 - 36 s y 

R, the strategy space of Player I, is a 3-dimensional solid whose boundary 

2 

consists of the curve C (defined parametrically by r 1 = t, r 2 = t , 
r^ = t 5 , 0 < t < 1 ), lines connecting the origin with each point of C 
and lines connecting (1, i, 1 ) with each point of C. S is defined in 
exactly the same way (S is the convex hull of the curve defined by 
s 1 = u, s 2 - u 2 , s^ - u 5 where 0 < u < l). 

Let 

f = -16 - 36r 1 - 9r 2 + l8r^, 

then we divide the spaces R and S into the following convex subsets 
R 1 (f<- 28 ), R g (f>-28), R 5 (f--28) 

3,(3, > f), S 2 (s,<|), S 3 (s, = §). 

W© now have the following mappings of R onto S and S onto R: 

R,—*0, 1, 0 
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u _ 10 - Vioo + St 

(>(5. 5-, zj) + (1 - P ) (1» 1, 1) where 0 < f £ 1 


(0, 0, 0) 

-3(2 - s,) -^3(753^ - 150s, + 68) 

6(33, - U) 

*(j, f, 5 ) + (1 - *)(0, 0 , 0) where 0 < <* < 1 . 
Prom the above, it can be verified that 

R,—*• s 3 —> r 3 if «. = |, p - I. 


This yields the unique solution 


F*(x) - \ I Q (x) + | 


G*(y) = j I,(y) + \ 
3 

where I_ is a step-function with a jump at 
is v - 6 . 
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ADMISSIBLE POINTS OP CONVEX SETS 
K. J. Arrow, E. W. Barankin, and D. Blackwell 

$1 . SUMMARY 

A point s of a closed convex subset S of k-space is admissi ¬ 
ble if there is no tGS with t^ < s.^ for all i *= 1 , ... k, t^s. An 
example is given in which the set A of admissible points is not closed. 
Let P be the set of vectors p = (p ] , p k ) with p i > 0 , 3 ^ = i, 

let B(p) be the set of s G S with (p,s) = min (p,t), and let 

tGS 

B - 2B(p), so that B consists of exactly those points of S at which 
there is a supporting hyperplane whose normal has positive components. 

THEOREM 1 . B C A C B. If S Is determined by a 
finite set, there is a finite set p 1 , ..., p^, p^ G P, 
such that B ~ B(pj), so that, since B(p) is 

closed for fixed p, B = A ■ B. 

That B C A C B when S is determined by a finite set was 
noted, in the language of convex cones, by Gale (2]. 1 

A consequence of Theorem 1 is that. In a two-person zero-sum game 
in which each player has only a finite number of pure strategies, every 
pure strategy which yields the value of the game against every minimax 
strategy of the opponent enters with positive probability into some minimax 
strategy, a result due to Bohnenblust, Karlin, and Shapley [1]. 

f2. PROOF OF THEOREM 1 

Suppose first that S is bounded. If s G S, s ( A, there is 
a tGS with t^ < s 1 for all 1 and t ^ s. Then (p,t) < (p,s) for 
every p G P, so that s ( B. Thus B C A. 

To show that A C B, let a G A. We may achieve 


1 Numbers In square brackets refer, to the bibliography at the end of the 
paper. 
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a - (0, o, by translating the coordinate system. For any 

£, o < a < let P(t) be the set of p G P with p.^ >* for 
i - 1 , k. For any two closed bounded convex sets R,S of k-space, 

there are vectors r* t R, s* G S with (r*,s) > (r*,s*) > (r,s*) for 
all r G R, s G S; this fact may be proved as follows. Let r n G R, s n G S 
be sequences dense in R,S respectively. The finite game whose NxN 
matrix is (r^,s.),l < i,j < N, has a value V(N) and good strategies 

(A N1' "u’ ’ (M N1* thus lf r *N = “'1“1 A Nl r i’ 

3 n * - Sj”, ^Nj 3 j> we have ^ r N* ,s j^ 1 V(N? ^ (r l’ s N #) for 1 i. 1 'j i N ‘ 
Letting N —* » through a subsequence for which p n*> s n* converge, say 
to r*,s*, yields (r*,Sj) > (r^s*) for all i,j, ana r*,s* have the 
required property. We apply this result to P(t),S, obtaining 
p(fc) G P(fc), s(a) G S such that (p(fc),s) > (p(a), s(fe)) > (p,s(e.)) for 
all p G P(€.), s G S, and note that (p(gj, s(£)) < (p(£), a) = 0. Choose 
a sequence t n —>0 for which s(£ n ) converges., say to s* G S. For all 
p G P, (p,s(£ n )) < 0 for sufficiently large n, so that (p,s*) < 0. 

Thus s* < 0 for all i and, since a = (o, 0, ..., o) is admissible, 
s* * a. Finally s(fc n ) G B(p(£ n )) C B, so that a G B. 

For unbounded S, we use the 

LEMMA. Let C be a convex set, N a neighborhood, 
and s Q minimize (p,s) for s G C A N. Then s Q 
minimizes (p,s) for s G C. 

PROOF. Suppose, for some s 1 G C, (p,Sj) < (p,s ). Let 
S 2 “ A3 0 + “ <*) S 1 ? for 0 < *• < 1 » s 2 G C ’ (P' S 2^ < (P^o 5 * But for * 

sufficiently small, s 2 G N, which contradicts the hypothesis. 

It follows from the Lemma that Theorem 1 holds without the con¬ 
dition that S be bounded. Let S be any closed convex set, a an 
admissible point of S. Let N be a closed neighborhood of a. Then a 
is admissible in SON. By Theorem 1, a = lim s n , where s n minimizes 

n-»oo 

(p n ,s) for s G S fl N for some p n in P. Then, by the Lemma, s n 
minimizes (p n ,s) for s G S for the same p n - 

Now suppose that S is determined by a finite set s 1 , ..., s m . 

A subset U of s 1 , ..., s ffl will be called usable if there is a p G P 
for which U C B(p). Let U 1 , ..., Ujj be the usable subsets of 
Sj, ..., s m , and let p 1 , ..., p^ be corresponding p’s, so that 
Uj C B(Pj) • Let sGB, say s G B(p), s A± a ±- Then u ls the 

set of s* for which A* ) o, U C B(p), since (p,s.) > min (p,t) for 
1 1 1 tGS 

G U would imply (p,s) - 2^ i (p>s 1 ) > min (p,t). Thus U is usable, 

wtGS 

say U « Uj. Then s G B(pj) and B B(pj) • This completes the proof. 
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4 3- AN EXAMPLE 

If k — 2, it is easily shown that A is closed; in our example 
k - 3 and A is not closed. Let U be the closed arc consisting of all 
points (x,y,1) with (~ - i) 2 + (y - i) 2 = i, o < x,y < 1 , let 
e * (1,0,0), and let S be the convex set oetermined by U and e. The 
point f * (1,0,1) G S is not admissible; we show that every point 
s o ■ (x 0 ,y 0 ,i) with x 0 ,y 0 ^ ° and (x o “ 1+ (y o " 1 ) 2 = 1 is admis¬ 
sible, in fact, that it is an element of B. 

There is a vector p - (u ,v ,0) with u. > 0, v >0, 

o o o o o 

u Q + v Q = 1 such that (p Q ,s) > (P 0 *s o ) for* ail s G S, s ^ s . Let 
p - (1 - £)p Q + £(0,0,1), 0 < € < 1 . Then p G P, and 

(p,s) - (1 -€)(p o ,s) + € for s G U, so that (p,s Q ) < (p,s) for 

s ^ s Q , s G U. Also (p,e) = (1 - £)(p o ,f) > (1 - €)(p o ,s Q ) + € - (p,s Q ) 
for £ sufficiently small. Thus s Q G B(p) for £ sufficiently small, 
completing the proof. 

We remark incidentally that e G A but e $ B, so that 
A ^ B, B ^ A In our example. 

$4. AN APPLICATION 

A consequence of our theorem is the following result of 
Botinenblust, Karlin, and Shapley [1]. 

THEOREM 2. Let A = | la^jll bo an m x n matrix, 
consioerec as the payoff of a zero-sun two-person game, 
and let D be the set <_f all 1 for which 
A(i,q) - a ij q j = v *' or mlnimax strategy q 

for II, where v is the value of the game. Then 
there is a minimax strategy p for I with p^ > 0 
for 1 G D. 

PROOF. If we delete from A the rows for which i D, the 
resulting game has value v, anu every minimax strategy for I In the new 
game Is minimax in the original game. Moreover A(i,q) = v for every 
1 G D and every minimax strategy q for II in the new game, for if 
A(i 0 ,q o ) X v for some i Q G D ana some minimax q^ in the new game, 

A(i Q ,q*) < v for every £ > 0, where q* *= £q Q + (l - €)q 1 ana q 1 is 
minimax in the original game. Since q 1 may be chosen so that 
A(i,q^) < v for i $ D, q* will be minimax in the original game for 
sufficiently small £ > 0, and I $ D. Thus we may suppose i G D for 
i - 1 , • •m. 

Let S be the convex set in m-spacc determined by the columns 
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of A. ' The point s - (v, v, .v) G S and is admissible, so that, by 
Theorem 1, there is a p G P with s Q G B(p). That is, 

(p # s Q ) - v < (p,s) for all s G S. Thus p is a minimax strategy for I, 
and > o for i G D. 

$ 5 • IMPLICATIONS FOR STATISTICS AND ECONOMICS 

Suppose we have a statistical problem with a finite number of 
possible states of nature. To each possible strategy of the statistician, 
there can be assigned a vector whose components are the risks of the 
strategy under each of the possible states of nature. Let S be the set 
of such vectors; S will be convex if mixed strategies of the statistician 
are admitted and closed under very general assumptions. Then if we define 
the distance between two strategies as the Euclidean distance between their 
risk vectors. Theorem 1 asserts that every admissible strategy is the limit 
of a sequence of strategies each of which is a Bayes solution against an 
a priori probability distribution which assigns positive probability to 
every state of nature. If S is determined by a finite set (for example, 
if the sample size is bounded, the variables observed take on only a finite 
set of values, and the number of actions among which choice is to be made 
Is finite), then there is a finite set of such a priori distributions such 
that a strategy is admissible if and only If it is Bayes against one of. 
these distributions. 

In an economic context, it is assumed that production is made up 
by carrying on different activities at varying levels of intensity. An 
activity is characterized by a vector a whose components are amounts of 
the different commodities passing through the activity, being positive for 
outputs and negative for Inputs. If the activity Is carried on at level x, 
the amount of commodity i produced is xa i (which is negative for in¬ 
puts) . If there are a finite number of activities a^, then the amount of 
commodity i produced Is Xja^. Let commodities l, ..., k be final for 
desired outputs, k + 1, ..., m be primary inputs. If the negative of the 
total available supply of commodity i(i > k) Is y| i# then the activity 
levels Xj must satisfy the conditions, 

> ii' (1 > k) - 

The image of this set in x-space under the transformation 
y^ ■ 1# •••* k) is then the set S of all possible combinations 

of final commodities possible with the given technology and resource limita¬ 
tions. S is clearly closed, bounded and convex. A point s of S is 
said to be efficient if there is no t G S such that t^ > s 1 for all i, 
t ^ s. By Theorem 1 applied to efficient points, there is a finite set of 
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vectors p, with p i > 0 for all i, such that s Is efficient if and 
only if s maximizes (p,s) for s £ S for some one of those p»s. The 
vector p can easily be interpreted as a set of prices for the final 
commodities, and (p,s) is the profit arising from the choice of activity 
levels leading to s. Hence, any efficient point can be arrived at by 
instructing producers to maximize profits for a suitable set of positive 
prices. (See Koopmans [ 3 ], especially Theorem k.3)- 

In the more general case where the number of activities is not 
finite, the activity levels will in general be replaced by a measure over 
the space of activities. The set S Is still convex, and, under suitable 
assumptions, closed. Then Theorem i tells us that we can approximate any 
given efficient point arbitrarily closely by instructing producers to maxi¬ 
mize profits given a suitably chosen set of positive prices. 

BIBLIOGRAPHY 


[1] BOHNENBLUST, P., KARLIN, S., and SHAPLEY, L. S., "Solutions of dis¬ 
crete, two-person games," Annals of Mathematics Study No. 2k 
(Princeton, 1950) pp. 51*72. 

[2] GALE, D., "Convex polyhedral cones and linear Inequalities," Activity 
Analysis of Production and Allocation (Cowles Commission Monograph 
No. 13: New York, John Wiley and Sons, 1951) PP- 287-297- 

[31 KOOPMANS, T. C., "Analysis of production as an efficient combination 
of activities," Activity Analysis of Production and Allocation 
(Cowles Commission Monograph No. 13: New York, John Wiley and Sons, 
1951) PP* 33-97* 


K. J. Arrow 
E. W. Barankin 
D. Blackwell 


Stanford University and 
University of California, Berkeley 




Part II 


INFINITE ZERO-SUM TWO-PERSON GAMES 


Among the zero-sum two-person games that have infinite sets of 
pure strategies available to the contestants, the "games on the unit square" 
continue to attract the main attention. These games generalize matrix 
games by replacing the elements a^j of a payoff matrix by a real-valued 
function K(x,y) defined on the unit square 0<x<1, 0 < y < 1 . The 
pure strategies available to players I and II are indexed by the real 
numbers x and y, while their mixed strategies become probability 
distributions over the unit intervals 0 < x < 1 and 0 < y < 1. This may 
seem entirely straightforward, but a large gallery of counter-examples has 
shown that such games can possess quite pathological deviations from the 
sound norm established by matrix games. So research continues in the 
direction of isolating classes of games on the unit square that will have 
suitably regular and manageable properties. 

The symmetric "games of timing" discussed by M. Shiffman in 
PAPER 6 can be interpreted as duels in which the opponents have equal 
strategic resources. Their pure strategies, x and y, represent the 
times at which they act (the later, the better). Shiffman shows that an 
optimal strategy is characterized- either as a density from some point a 
to 1 in the unit interval, satisfying an integral equation with positive 
kernel, or as such a density combined with a jump at o. Existence, unique¬ 
ness, and method of construction of the optimal strategy are obtained 
thereby. The jump at 0 is excluded or not according as an eigenvalue of 
the integral equation attains the value 1 or not. In certain cases, the 
integral equation can be replaced by a system of linear differential 
equations. 

In PAPER 7, S. Karlin continues the study of "games of timing" 
with the restriction to equal strategic resources removed. Even so, he 
finds unique solutions which consist of absolutely continuous distributions 
in the interior of the unit interval with possible jumps at the endpoints. 
The densities occur as solutions of certain integral equations and are 
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©pressed either as Neumann series or as eigenfunctions of integral 
operators. In addition Karlin solves another type of game in which the 
payoff K(x,y) is concave in each variable separately on each side of the 
diagonal x - y; the solutions are densities absolutely continuous over 
the closed unit interval. (Some particular games of this type, called 
"butterfly games," in which the payoff is monotonic away from the diagonal, 
have been treated by I. Glicksberg and 0. Gross.) 

The class of games considered by Karlin in PAPER 8 is a natural 
extension of the notion of convex game (see Study 24, Paper 15)» The 
payoffs K(x,y) considered are assumed to have positive nth partial 
derivatives with respect to y. The author carries out a detailed analysis 
for n - 1, 2, 3, 4 and shows that player I has an optimal strategy which 
is a step-function with at most n steps, while player II needs at most 
^ steps in some step-function strategy (jumps at the ends of the interval 
being counted as half jumps). It is asserted that the theorem holds for 
arbitrary n. 

Polynomial games (see Study 24, Paper 14) form a class of infinite 
games that have finite-dimensional sets of mixed strategies, just as finite 
games do. But any hope that this characteristic might extend to games with 
rational payoff functions has been dashed by I. Glicksberg and 0. Gross in 
PAPER 9, where they exhibit some of the pathology of such games. They 
match the known fact that polynomial games always have step-function solu¬ 
tions with an example of a game which has a continuous rational payoff but 
which has only densities as optimal strategies. This example involves an 
interesting application of Tarski r s system of "elementary algebra." They 
also construct a rational-payoff example that has unique optimal strategies 
based on dense, countable sets. Finally, to point up the exceptional 
perversity of games on the square, they propose a method which constructs a 
game in C°° having an arbitrarily given pair of distributions as unique 
optimal strategies. 

PAPER 10 by D. Blackwell deals with a type of infinite game, not 
on the square, that has a statistical context. The payoff is a function 
L(u, x, i), where a) is an element chosen by player I from a set Si, 
finite or infinite, x is a point chosen from a space X by a Chance move 
defined by a probability measure P^ over X depending on u*, and i is 
an integer chosen from 1,2, ..., k by player II, who is informed of x 
but not of oi* A pure strategy for player II Is a partition of X into k 
mutually .disjoint sets, while a mixed strategy for II is a probability 
measure defined on such partitions. An alternative method of randomizing, 
directly related to Kuhn's "behavior strategies" (see Paper 11, this Study), 
is to assign a probability distribution on the integers 1, 2, ..., k for 
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each x in X. Blackwell shows that, from the point of view of payoff, 
these two methods of randomizing are equivalent to one another and to a 
denumerable mixture of certain canonical pure strategies. 


H. W. K. 
A. W. T. 




GAMES OP TIMING' 

Max Shiffman 

SUMMARY 

We introduce the notion of a symmetric game of timing . It is 
defined here as a continuous game involving the bilinear functional 

f'oj'o K(x,y)dP(x)dG(y) , K(x,y) = -K(y,x) 

in which for x < y, K(x,y) is a strictly Increasing function of x and 
a strictly decreasing function of y (more precisely defined in 4 1 )• If 
K(l~, 1) £ 0 , there is an optimum pure strategy at 1 ; if K(o,i) > 0 , 
there is an optimum pure strategy at 0. Aside from these trivial cases, 
it is proved that there is a unique optimal strategy which is either a 
density from some point a to 1, or is a jump at 0 and a density from 
a to 1 . If the quantity K(y~",y) varies in sign as y varies, let b 
be the value such that K(b”~,b) = 0, while K(y~,y) > 0 for b < y < 1 . 

In this case, the optimal strategy is a density from a to 1 where 
a > b. It is shown that the determination of the density function depends 
on the solution of a certain integral equation with positive kernel, and 
the theory of such integral equations is discussed and applied. It is also 
shown that for a general category of cases the optimal strategy can like¬ 
wise be obtained in terms of a system of ordinary Linear differential 
equations. 


$ 1 . PRELIMINARIES 

We shall consider a class of symmetric continuous games involving 
the bilinear functional 



K(x,y)dP(x)dG(y) 


^This paper was prepared as a report (Sept. 6, 19^9) for the RAND 
Corporation. 


97 



98 


SHIFTMAN 


where x, y range over the real numbers from o to l Inclusive, the 
symmetry of the game reflecting itself in the skew-symmetry of the kernel 
K(x,y): 

K(x,y) - -K(y,x) . 

Concerning the kernel K(x,y), we will suppose that for x < y K(x,y) is 
a strictly increasing function of x and a strictly decreasing function 
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0, < y < P 2 or y = constant, A, < x < A g . 2 

As a consequence of (1 b), we can assert that 

A^x.y) > 0, Ay(x,y) <0 for x < y . 

The condition (l c) makes a mild limitation on the places where either of 
these derivatives is zero. 

We shall show that, aside from trivial cases, the optimal strate¬ 
gy of a game of timing is unique and consists either of a density function 
from some point a to 1, or consists of a jump at 0 and a density from 
some point a to 1 . The optimum strategy will be obtained as the solu¬ 
tion of a certain integral equation with a positive kernel. In a wide 
category of cases, this integral equation is equivalent to a certain linear 
differential equation or system of linear first order differential equa¬ 
tions . 


$ 2. GENERAL CONDITIONS ON AN OPTIMUM STRATEGY 

It is easy to show the following: if A(1,1) £ 0, a pure 
strategy at 1 is the unique optimum strategy; if A(o,i) > o, a pure 
strategy at 0 is the unique optimum strategy. We exclude these trivial 
cases and suppose henceforth that 

(2.1) A(0,1) < 0, A( 1 ,1) > 0 . 

We shall first suppose that there is an optimum strategy F(x) 
for the game, and derive necessary conditions satisfied by F(x). Thus 

> o for all y , 


K(x,y)dF(x)dF(y) - 0 

by the skew-symmetry of K(x,y). 


( 2 . 2 ) 

while 

(2.3) 


V(y) 


fc K<X, 


/; 


V(y)dF(y) 


y)dF(x) 


fill 


2 The reader may If desired make the further simplification A_(x,y) > 0, 
Ay(x.y) < o for x < y. 
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LEMMA 1. F(x) cannot have a jump at an interior 
point x Q , 0 < x Q < 1, unless A(x 0 ,x Q ) - 0. F(x) 
does not have a jump at x * 1 . 

PROOF. If F(x) had a jump at such a point x Q , o < x Q < 1, we 

would have 

V(x 0 ) = J ] 0 K(x,x Q )dF(x) * 0 
+ 

by virtue of (2.2), ( 2 . 3 ). Letting y —> x Q ~ in ( 2 . 2 ), 

V(x 0 + -) = Jl K(x,Xq)6FM > 0 , 

so that 

J | K(x,x 0 “) - K(x,x 0 )| dF(x) > 0 . 

+ 

But K(x,x q ”) - K(x,x Q ) = 0 except for x = x Q , and we have 

+ A(x 0 ,x 0 ) | P(x Q + ) - P(x 0 ") | > 0 . 

The first part of the lemma is proved. 

The above argument also shows that the following statement can 
be made at the end-points 0,1: 

(2.0 A(0,0)F(0 + ) > 0 , A(1,0(1 - P(1")) < 0 . 

Because of A(l,l) > 0 , the second part of the lemma is proved. 

The quantity V(y) is continuous , except at y = 0 if 
A(0,0)F(0 + ) f 0. For, if x Q ^ 0, 

v (x Q ") - V(x Q ) = /1 K(x,x Q ") - K(x,x Q ) | dF(x) 

- * A(x 0 ,x 0 ) j F(x 0 + ) - F(x 0 ") |=0. 

while 

V(0 + ) - V(0) - A(0,0)F(0 + ) > 0 . 

It follows from (2.2) and ( 2 . 3 ) that 
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( 2 . 5 ) V(y) = 0 for all points y In the spectrum of F(x) 


LEMMA 2 . 
interval from 
interval from 


The spectrum of F(x) either is an 
a to 1 , or is the point 0 and an 
a to 1 , where a < 1 . 


PROOF. Denote the closed point set which is the spectrum of F(x) 
by S. If S is not the entire set from 0 to 1 , let p < y < q be 
one of the open intervals composing the complement of S. For any point y 
in this interval. 


V(y) 


if 


A(x,y)dF(x) 


/;■ 


A(y,x)oF(x) 


so that, by hypothesis (l b), V(y) is a strictly decreasing function of 
y in this Interval. By virtue of ( 2 . 2 ) and ( 2 . 5 ), the left-hand end-point 
p of the interval must be 0 . Otherwise p would belong to S, V(p) = 0 , 
and by the continuity of V(y) at p, we would then have V(p + <f) < 0 
for small positive This contradicts ( 2 . 2 ), so that p = 0 . The right- 

hand end-point q cannot be 1 . Otherwise, l would not belong to S by 
Lemma 1 , and 0 would be the only point in S; then ( 2 . 2 ) contradicts 
( 2 . 1 ) . The lemma is proved. 

The hypothesis (1 b) makes no assertion concerning the behavior 
of A(x,x), except that for x near 1 we have A(x,x) >0 by ( 2 . 1 ). 

If there are points x on the main diagonal where A(x,x) = 0 , let b 
be the maximum of all such points x. Thus A(b,b) = 0 , while for 
b < x < 1 we have A(x,x) > 0 . If there are no points x where 
A(x,x) = 0 , we set b = 0 . The interval b < x < 1 will be called the 
basic Interval , by virtue of the following lemma. 


LEMMA 3- The spectrum of F(x) lies completely 
in the basic interval b < x < 1 . 

PROOF. This lemma makes an assertion only if b > 0 . Consider 
a new game in which the pay-off is K(x,y) but in which x, y are limited 
to the interval b < x < 1, b < y < 1. This is again a game of timing, and 
we shall show later in the paper that a game of timing has a solution. 


^By the spectrum of F(x) is meant the set of points x such that either 
F(x_ + £) > F(x_) for all positive <f, or F(x - 4) <JF(x ) for all 
positive o u 
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Assuming this, let the solution to this game be $(x), b < x < 1, with 
$(1) - 1, $(b) * o. Extend <t>(x) below b by setting 4>(x) * o, for 
x < b. Set 

V(y) = JJ K(x,y)d0(x) . 

We have: V(y) > 0 for b < y < i since <J>(x) is the solution to the 
gepe in the interval b < x < 1 . We have 

7(b‘) - V(b) - |K(x,b') - K(x,b) | d*(x) = o 

since A(b,b) = 0. Thus V(b“) V(b) >0. In the Interval from o to 
b, V(y) is a strictly decreasing function of y., so that we may assert 
that 


V(y) >o in o < y < b . 

Suppose now that there were points of the spectrum of F(x) in 
the interval o < x < b. Then we would have 

Jo V(y)dP(y) > 0 . 

But / V(y)dP(y) = f' 0 f' 0 K(x,y)d<Mx)dP(y) = - K(x,y)dF(x)d<|>(y) - 

- V(y)d<|>(y) < 0 since V(y) > 0. This contradiction establishes 

Lemma 3• 

Lemma 3 shows that we need only consider the game over the basic 
interval b < x < 1 . Henceforth, we consider only the basic interval, and 
ignore the values before this basic interval. With no loss of generality, 
we can let this basic interval be the interval from 0 to 1, so that 
we have 

(2.6) A(x,x) > 0 for 0 < x < 1 . 

LEMMA k. In a < x < 1, F(x) has a continuous 
derivative F'(x) = f(x). 

PROOF. Set F(0 + ) = ot, o < <*. < i . Let y be any point in 
a < y < 1 • Then ( 2 . 5 ) gives 

( 2 . 7 ) 0 - dA(0,y) + J* y + A(x,y)dF(x) - Jy A(y,x)dF(x) . 

Suppose first that A(x,y) has continuous second derivatives. Then 
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transform ( 2 . 7 ) by integration by parts into 


0 


- <*A(0,y) - <kA(a,y) - A(y,1) + 2F(y)A(y,y) 

- J* y + F(x)A 1 (x,y)dx + F(x)A 2 (y,x)dx 


where the subscript 1 , 2 means differentiation with respect to the first 
or second argument respectively. This equation can be solved for F(y), 
since A(y,y) / 0 , and shows that F(y) has a continuous derivative in 
' a < y < 1 . 

If A(x,y) does not have continuous second derivatives, we can 
proceed directly from ( 2 . 7 ). Rewrite ( 2 . 7 ) in the form 


0 = *A(o,y) + j lA(x,y) - A(y,y) )dF(x) 

-J y (A(y,x) - A(y ,y) }dF(x) + A(y,y) l2F(y) - ok - 1 ) 

and solve for F(y). The result shows that F(y) has a continuous deriva¬ 
tive with respect to y by virtue of the following remarks: 

If B(x,y) is continuous and has continuous first derivatives, 
if B(y,y) = 0, and if F(x) is a continuous distribution function, then 


J y B(x,y)dF(x) 

has a continuous derivative with respect to y. For 

K |/ y a h B(x,y+h)dP(x) - J** B(x,y)dF(x) | = 

Jy B(x„yfh) h - B(x,y) + Jy+h )-.oF(x) . 

The first integral approaches /•[ B__(x,y)dF(x) as h—■> 0, while the 

a y 

second integral can be estimated by 

|Jy+h B(x,y+h? h - B(y+h ; , y+h l < M | p(y+h ) . P(y ) | , 

where M is a bound in the first derivatives, and this approaches zero 
as h —> 0 . Thus the derivative exists and 

J*! B(x,y)dF(x) - J'l B y (x,y)dP(x) . 

This shows that the derivative is continuous. 

The lemma is proved. 
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i 3- THE INTEGRAL EQUATION FOR f(x) 

In (2.5), set F’(x) = f(x), where f(x) ^ 0: 

( 3 . 1 ) 0 - dA(o,y) + A(x,y)I (x)dx - A(y,x)f (x)dx, a < y < 1 . 
Differentiation of (3.1) gives 

(3.2) f(y) ~ dp(y) L(x,y)f(x)ax, a<y<i > 

where 

(3.3) 
and 


(3.4) 


as the fundamental integral equation which f(y) satisfies. 

The kernel L(x,y) and the function dp(y) are everywhere > 0 
by virtue of hypothesis (1 b) and equation (2.6). Also, in case 
A(0,0) = 0 , we see from (3-1) that a > 0; otherwise, b;y letting y —> 0 
in (3.1) we would obtain a contradiction. Thus, A(y,y) > 0 everywhere in 
the closed interval a < y < 1, and the functions L(x,y), «ip(y) are 
uniformly bounded in the interval of integration. 

Equation ( 3 . 2 ) is the fundamental integral equation satisfied by 
f(x). But we must also have 

(3-5) Jl f(x)dx - 1 - * 

and, setting 

(3-6) W = *A(0,y) + A(x,y)f(x)dx - A(j,x)f(x)dx , a<y<1 » 

which must be constant for a < y < 1 by virtue of (3-2), we must have 


p(y) 


A 2 (0,y) 

2A(y,y) 


<*-> o , 


L(x,y) 


A 2 (x,y) 

2A(y,y) 


A,(y,x) 
2A(y,y) 


for 


for 


x < y 


x > y 


(3-7) 


V - 0 . 
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Conversely, if for some eL and a, o<cn<i,o<a<l, there 
Is found a non-negative function f(x) satisfying (3*2), (3*5), (3*7), 
then 


(3-8) 


F(x) 


r o for X - o 
d. for o < x < a , 

' /a f( £ )d t for a < x < 


is an optimal strategy. For, from (3-7), it follows by multiplying (3.6) 
by f(y) and integrating from a to 1 that 

( 3 . 9 ) 0 “ ^ J*a • 

Then we have, for V(y) defined in (2.2), 


V(y) 


0 for y = 0 in case bi ^ o 

positive and monotonic decreasing for 
° < y < a (for 0 < y < a if <*. =* 0) 

0 for a < y < 1 


Therefore, V(y) satisfies the inequality 


V(y) > o 

and this means that F(x) is an optimal strategy. The following theorem 
has been demonstrated: 


THEOREM. There is an optimal strategy F(x) if 
and only if there are numbers d, a, 0 < cL < i, 

0 < a < 1 and a non-negative function f(x), defined 
in a< x < 1, which satisfies the equations (3-2), 

(5-5), (3-7). Then F(x) is given in (3-8). 

ib. ON INTEGRAL EQUATIONS WITH A POSITIVE KERNEL* 1 
Consider the homogeneous integral equation of the second kind. 


k 


The theorems obtained in 


$ k are related to similar questions studied by 
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(4.1) L(x,y)f(y)dy - Xf(x) , p < x < q , 

or, in operator form 


.Zf(x) - Af(x) 

where <£f(x) is the integral operation on the left-hand side of (4.1). We 
will suppose that the kernel L(x,y) is non-negative , and we are interested 
in non-negative solution f(x) of (4.1), i.e., 


(4.2) 


f(x) > o , o < J f(x)dx < 00 , 


(throughout this digression, all integral signs will be understood between 
the fixed limits p, q). The class of functions satisfying (4.2) will be 
denoted by P ] . To be specific, the assumptions on the kernel L(x,y) are 
as follows: 


(4 a) 


L(x,y) > 0 , 


the points where L - 0 forming on each line x = constant or line y = 
constant a point set containing no intervals. 


(4 b) 
(4 c) 


L(x,y)<M 

J*|L(x 2 ,y) - L(x ] ,y)| dy —> 0 and 

J*|L(x,y 2 ) - L(x,y 1 )j dx —> o if 

|x 2 - x 1 | —> o or |y 2 - y 1 | —> o respectively 


Weaker assumptions can be made if desired. It follows from 
(4a), (4b), (4c) that if f(y) is in P 1 , then 


J*L(x,y)f(x)dx and J~L(x,y)f(y)dy 


are continuous functions of y and x respectively, and if f(y) is in 
addition continuous they have a positive minimum . 

We shall prove the following theorems. 


.. .. 11,11 .. 

Perron and by Frobenius for finite matrices and by Jentzsch for integral 
equations. The maximum property of the eigenvalue was told to me by 
3. Karlin, and is related to unpublished work of Bohnenblust and Karlin. 

See Perron, Math. Ann. 65 (1907;,. pp. 248-263; Frobenius, Berl. Ber. ( 1908 ), 
pp. 471 - 1 * 76 ; Jentzsch, J. Heine Angew. Math. i4i ( 1912 ), pp. 235-244. 
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1. There exists a unique f(x) in Pj, normal¬ 
ized by /f(x)dx = 1, satisfying (4.1) for some posi¬ 
tive A. 

2. If a is a positive number such that 

(4.3) J*L(x,y)g(y)dy > Ag(x) , a<x<b 

for some g(x) in P 1 , then a < A and /u = A only 
if g(x) is a multiple of f(x). (Maximum property of 
the eigenvalue A.) 

3. The inhomogenous equation 

(4.4) <|)(x) = h(x) + (*J* L(x,y) (|)(y)dy 

where h(x) is a given function in P 1 and > 0 

has a solution <J)(x) in P 1 if and only if f> < ^ . 

The solution Is then unique and is given by (4.5) 

(J)(x) = h(x) + 2v=i where <£ V means the 

V th Iterate of <2. 

4. If Y is absolutely integrable, and 

Y(x) < h(x) + L(x,y)y(y)dy , where p< j , 
then 

Y(x) < 0(x) 

everywhere. 

PROOF, (l) and (2). Consider the set J"L of a's satisfying 
(4.3) for some g(x) In P 1 . Setting g(x) = 1, shows that there are 

positive a' 3 in namely A = Min / L.(x,y)dy. Also, Integrating (4.3) 

x 

with respect to x and using condition (b) shpws that 

A < M . 

Normalizing the functions g(x) in (4.3) by supposing / g(x)dx * l, we 
see that 
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g(x) < for every x . 

Let A » Slip >u. There is a sequence —> A with g.»(x), normalized, 

satisfyin s 


(4.6) 

But then also, 

(4.7) 


lg t (x) > 




The functions <£g^(x) are positive continuous functions, and are 
equic ontinuous. For, 

IJ'lCx,, y)g 1 (y)dy - J*L(x 2 ,y)g i (y)dy| < 

^ J^L^.y) - L(x 2 ,y) | dy 

and equicontinuity follows from hypothesis (4 c) concerning the kernel 
L(x,y). The theorem of Arzela shows that a subsequence can be found such 
that <SCg 1 (x) converge uniformly to a continuous non-negative f (x) . From 

(4.7) we find 


(4.8) 


.£f(x) > Af(x) , 


while integrating (4.6) shows that /f(x)dx > A, so that f(x) is not 
identically 0. Thus A belongs to the set A. But in fact, equality 
holds in (4.8). For, both sides of (4.8) are continuous functions, and a 
strict inequality at any point x would show that 

itff(x) - Af(x)) > 5 > 0 


for some positive <£. But then 

/(Jtf(x)) > AZf(x) + <f > (A + gtffU) 

where N * Max (x). This shows that A + 4 belongs to the set Si, 
x n 

contrary to the definition of A- Therefore 


(4.9) *f(x)-Af(x) 

and Theorems (l) and (2) have been established, except for the uniqueness 
of f(x). 
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The equality (4.9) shows tliat f(x) has a positive minimum. The 
above establishes the existence of a solution g(y) in P 1 to the 
transposed equation 


/ 


L(x,y)g(x)dx - A'g(y) ■ 


The function g(y) is also continuous and lias a positive minimum. 
Multiplying this equation by f(y) and integrating with respect to y 
yields 


>/ 


A I f(x)g(x)dx 


y f 


f(y)g(y)dy 


or A = A* since /f(x)g(x)dx > o. This shows tliat there cannot be a 
solution in P 1 of (4.1) for any other value of A- Suppose now that 
there Is another solution h(x) of (4.9) in P 1 . Let 




so that h(x) - cf(x) > o and = o in at least one point. But since 


X(h(x) - cf(x)) - A(h(x) - cf(x)) 


It follows that h(x) - cf(x) has a positive minimum (unless it is 
identically zero). This shows that, Indeed, 

h(x) - cf(x) , 


and the uniqueness In (1) is established. 

REMARK. The proof we have given depended on Arzela's theorem. 
Other proofs and other methods can be given depending on notions of weak 
convergence and applicable to different classes of kernels L(x,y). 

(3). Let (4.4) have a solution In P 1 . Let g(x) be the posi¬ 
tive eigenfunction for the transposed homogeneous equation (with the same 
eigenvalue A) . Multiplying by g(x) and integrating gives 


J <J>(x)g(x)dx ~ j* h(x)g(x)dx 



<Kx)g(x)dx 


or 


(1 - Pa) 



x)dx 



x)dx . 


The integrals appearing are both positive and this requires that 
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1 - M > 0 or P < j . 

For f < j , let S n (x) be the first n+1 terms of the right- 
hand side of (4.5), 

S n (x) - h(x) +Xv«i h (x) * 

Multiplying by g(x) and integrating gives 

Js n (x)g(x)dx = J h(x)g(x)dx . ( l + ^^ ) 

or 

lim J S n (x)g(x)dx * * J h(x)g(x)dx . 

The sequence S n (x) is an increasing sequence of (positive) functions 
which converges to a function <Mx) (with +« admitted as a value) . 

Since g(x) > 0 it follows from a standard theorem that <|>(x)g(x) is 
integrable (so that » is taken as value at most on a set of measure zero) 
and 

/♦' x)g(x)dx = y-T-fr J^h(x)g(x)dx . 

But, since g(x) has a positive minimum, <p(x) is also integrable. 
Concerning S n (x) we know that 

S n (x) - h(x) +/°iS n-1 (x) . 

A passage to the limit yields 

<t>(x) - h(x) + P& Kx) , 

and indeed a solution is obtained to (4.4). 

Let y(x) be any solution to (4.4), so that 

Y(x) - $(x) - PJ* L(x,y) (y(y) - 4>(y))dy . 

Therefore 

|Y(x) - «(x)| <rfux,Y) ir(y) - *(y)l dy . 

Since £ > A, ve see that |Y(x) •- $(x) | must be a null function, or 
Y(x) - ♦(x). 
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(4) . Successive Iteration of* the inequality gives 
V< h + l°ih + ... + 


so that 


r< 4 > + P n X. n Y. 


Now 


i A’V 1 n < p'Y'iyi 

and this approaches zero almost everywhere, by the argument in the proof of 
3 above (convergence of the series (4.5)). Thus, Y < <t> almost every¬ 
where. But the inequality then gives 

r< h + P2<p = (p 

so that Y< <J> everywhere. This completes the proof of the entire theorem. 

^ 5 • THE DEPENDENCE ON LIMITS OF INTEGRATION 

Suppose that L(x,y) Is defined over some rectangle, say 
0 < x < 1, 0 < y < 1, and satisfies conditions (4 a), (4 b), (4 c) there, 
and that p(y) Is defined In ° < y < 1 and is continuous and of class 
(P^ . Consider the Integral equations In , 

(5-1) L(x,y)f a (x)dx = A(a)f & (y) , a<y<l , 

and 

(5.2) 0 a (y) = PW + fa L(x,y)$ a (x)dx , a < y < 1 , 

where o < a < l . We shall discuss the dependence of the positive eigen¬ 
value A(a), the non-negative normalized eigenfunction f & (x), 
and the solution <(> a (x) of the inhomogeneous integral equation on the 
parameter a. A similar consideration applies If the upper limit is varied 
instead of the lower limit. 

THEOREM 5•1 * The eigenvalue A(a) is a strictly 
decreasing continuous function of a with A(a) —*> 0 
as a —> 1 . 


PROOF. For a' < a, define 
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Then 


h(x) 


{ 


0 , 
f a (x) , 


a' < x < a 
a < x < 1 


J a ' 


L(x,y)h(x)dx 


A 


L(x,y)f a (x)ax 


non-negative , 
A(a)f a (y) , 


and 


so that 



L(x,y)L(x)dx > A(a)h(y) 


a' < y < a 

a 1 y < 1 


M a’) > A(a) • 

Furthermore, equality can hold only if h(y) is an eigenfunction for the 
interval a' < y < 1 . But h(y) - 0 on a sub interval, and an eigenfunction 
has a positive minimum. Therefore, 

A(a') > \(a) . 

Over the smaller interval a < x < 1, use the function f &l (x)• 

We have 


where m 


J* a L(x,y)f a ,(x)dx = A(a')f a ,(y) - J* a , L(x,y)f a ,(x)dx 
> Ma’)f a ,(y) - (a - a') 

> tA(a,) - iwr (a - a,)) f a'<y) 


rain f.,(y) > 0, and we have used 

y a 

|f a' (y)l i Tta 7 ! • 


Therefore 


*<a) > **"> - ST^aT (a * a,) * 

and this establishes the continuity of A(a). 

By integrating (5*1) with respect to y, we obtain 
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A(a) < Max j a L(x,y)dy < M(1 - a) . 

Hence A(a) —> o as a —-> 1 . This completes the desired proof. 

THEOREM 3-2. The eigenfunction f Q (x), a < x < 1, 
converges uniformly*' to f a ,(x), a' < x < 1, if 
a —> a'. 

PROOF. From (5*1) we find 

(5-3) 1 XRT for all y In a<y<l . 

Also, 

Me.) |f a (y,) - f a (y 2 )l < J*IL(x,y,) -L(x,y g )| dx . 

Thus as long as a Is bounded away from 1, the functions f a (y) are 
equicontinuous, and as a —> a' a subsequence can be found which con¬ 
verges uniformly to a function which must coincide with f a »(y) since 
equation (5*1) for a' Is satisfied by the limit function. Since this is 
true for every infinite set of a's —> a‘, the theorem is proved. 


THEOREM 5*3. The function <t> (x), a < x < 1, 
converges uniformly*' to <t> a ,(x) as a —v> a' if 
A(a') <1. If A(a 1 ) = 1, then 


/ 


a ♦a (x)dx _ > 


and 


/ a $ a (x)dx 


converges uniformly*' to f_ (x). 

a, 


PROOF. Let g a (x) be the eigenfunction solving the transposed 
equation to (5■ 1 ). Then, 


p(y)fc a (y)ay • 

If a lies in the range a 1 +tf<a<i-«f for some positive 4, then 
by the uniform convergence of g a (y) as a varies there is a positive 
lower bound m of g a (y), and the same upper bound as f & (x) in the 


■'The sense is clear; for example, by transforming the differing intervals 
of definition of the functions into a common interval by linear trans¬ 
formations . 
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proof of Theorem 5«2: 


0 < “ < eaW i°xfaT • 


Therefore 

(5A) fa p(y)dy < Ji V y)dy < sn^ayrr^rr /a p(y)dy • 


Equation (5-2) gives 

(5-5) V y) < p(y) + mA(a)0-*(a)) /i p(y)dy < M 1 

and therefore 

1 *a (y i J ' '•a ^ 1 i ip(y 2 ) ■ pty^i + M i Ji i L ( x >y 2 ) - L(x,y,)i dx . 

This proves the equicontinuit^ of <t> a (y) , and as in the proof of 
Theorem 5*2 the uniform convergence of <|> a (y) to <l> a ,(y) as a —> a*. 

If a —> a 1 , where A(a 1 ) = 1, the unboundedness of /a^a^ dx 
is stated in (5-4). Also, 


and 


♦a(y) 


p(y) 


;^ a (x)dx - /]<i> n (x)dx 


+ m < m 2 


'a T a' 


l<» a ( y 2) - ^(y,) I 

4 <t, a (x)dx 


. Ip(y 2 ) - p(y,)I Ci 

< -;- + M 2 I ’ |L(x,y 2 ) - L(x,y.) I dx . 

/;<!> ( x)dx 2 J a 2 1 


Again this establishes the uniform convergence of 


( f a (x) 

/lV x)dx 

to the solution f fi (x) of the homogeneous equation. 
a 1 

It also follows from Theorem 4 of $ 4 that 4> a (y) > ^.(y) if 

a < a*. 


THEOREM 5*4. 6 For a 1 < a < 1, there is a non- 


^By virtue of & supplementary remark at the end of the paper, this theorem 
is not necessary for the application to games of timing. 
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negative function K(x), a < x < 1 such that 


/ I - ♦„(*> 

j 1 - h » a (a) - V a (x) I dx —> 0 as h —> 0 , 


where a is the maximum of a, a+h. This function 
^(x) satisfies the integral equation 

(5.6) V a (y) - L(a,y) + L(x,y) Y a (x)dx , a<y< 1 . 


If 


E J* a a h L(x,y)dx —■> L(a,y) as h —-> 0 for each y £ a 


then $ a (x) exists and 


rjx) 


TaT ^ 


♦a+h ( y ) gives 


PROOF. Subtraction of the equations satisfied by <t> a (y)> 


4>o + h(y) - KW fi , / 4> a+h (x) - 0 (x) v 

E*,i«> — ° hOS ‘ ) 


dx 


* E /*i b W-.J) 14 


a' 

<Mx)dx 




where a - min (a,a+h). Define y a (y) as the non-negative solution of 
(5-6), and set 


(5-7) 


4> h (y) - <L(y) 

—Irrnzf - v a<y> - Wy) . 


/= n i 1 r a+h r , , 't'g(x) 

(5 - 8) e J a L < x ’y> tjzt 


dx - L(a,y) - J * L(x,y)^(x)dx 


7<y) 


We have 


or 


X(y) = ^(y) + J” 1 L(x,y))((x)dx 
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(5-9) l%(y) I < Pity) I + J^L(x.y) IX(x)| dx 

Theorem 4 of 4 4 and (5•4) gives 

( 5 . 10 ) 

But 


/i 'w fl y < m A(a )f?-xc>)) /s |T i (y)l dy • 

c*\ / r/ a i^o^ x )^ x \ C\ 

f. I^(y)l dy < ( ‘ »;TaT -') J s L(a,y)dy 

+ E J a l h l L ( x 'y) - L(a,y)| dy ] dx 


fi f 5 L(x. 
«/ a J a 


,y)Y a (x)dxdy 


By virtue of hypothesis (4 c), the uniform convergence of $ a (x), as in 
Theorem 5-3, and the bound (5-5) for y a (x), it follows from this estimate 
that 


is |T,(y) 


j dy and therefore 


n 


iy(y) I dy —> 0 as h —■> 0 , 


and this proves the main portion of the theorem. If 

H f a l h L ( x >y) 6x —> L(a,y) for each y > a , 
this means that r[(y) —■> 0 for each y > a, and therefore from 
IX(y) I < l>)(y)l + M Ji !X<x) t dx 


we see that %(y) —■> 0 . 

We can also assert that 


q.e.a. 


W ( y ) -» a ( y ) 

h 

remains uniformly bounded as h —> 0 . For, the uniform boundedness of 
Y^(x) is obtained as in (5-5)/of >j(y) from its definition in (5-8), of 
X(y) from (5-9) and (5«io), and finally of the desired quantity from (5-7)- 
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4 6 . THE OPTIMAL STRATEGY 

The theory of $$ 4, 5 will now be applied to the particular 
integral equation (3*2) with kernel L(x,y) given by (3-4). The condi¬ 
tions (4a), (4b), (4c) are easily verified. The parameter a is to 
vary over the range o < a < l, except that if A(o,o) - o the case 

a = o is to be excluded. As in 4, 5 denote the positive eigenvalue of 

the homogeneous equation by A(a), and the positive eigenfunction by 
f a (x)' a < x < 1 • 

The integral equation (3 • 2 ) lias a non-negative solution for 
« 0 only when A(a) = 1, and for dt > 0 only when A (a) < 1. There 

are two cases: either there is a value a 1 s.uch that A(a^ « 1 , or 

A(a) < 1 for all a. 

Case I. A(a.,) - 1 . When a = a 1 and <K = 0 , the function 

f (x) satisfies the integral equation ( 3 * 2 ) and the condition (3-5)• The 
a 1 

corresponding quantity W defined in ( 3 * 6 ) vanishes, since this is obtained 

by multiplying (3 6 ) bj f (y) and Integrating from a. to 1, the 

a 1 

double Integral on the right-hand side vanishing by the skew-symmetry of 
the kernel. The theorem of f 3 shows that we have an optimum strategy. 

That this is a unique optimum strategy follows from the discussion in 
Case II below. 

Case II. A(a) < 1 for all a . We consider here also Case I, 
but then limit the range of a to a 1 < a < 1 . For the positive solution 
of ( 3 - 2 ), set 


f(x) « «H> a (x) 

where <f> a (x) satisfies 

(6.1) <J> a (y) - p(y) + L(x,y)<|> a (x)dx , a < y < 1 . 

The condition (3-5) becomes 

(6.2) JaV x)dx “l^ 

which gives a unique determination cL(a), 0 < «n(a) < 1 , in terms of a. 
Denote the quantity defined in (3*6) by W(a), and set 


where 


§ 1 } - u < a > 
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(6.3) U(a) - A(0,y) + Ja A(x,y)$ a (x)dx - J | A(y,x)4» a (x)dx , 

a < y 1 1 . 

the value being independent of y when y varies in the indicated range. 
The parameter a must be determined by the remaining condition ( 3 . 7 ) • 


LEMMA. U(a) is a strictly decreasing, continuous 
function of a with the following properties: 

11m U(a) = A(0,1) < 0 
a —> 1 



U(a) < 0 


in case 


A(a 1 ) 


1 


U(o) 


-■ — > 0 

1 + ♦o (y,dy 


in case A(a) < 1 for all a 
and A(o,0) > 0 . 


PROOF. The continuity of U(a) is a consequence of Theorem 5-3. 
The first limiting relation is clear. To obtain the second and third 
relations, use two equivalent forms of ( 6 . 3 ). First multiply ( 6 . 3 ) by • 

$ a (y) and integrate with respect to y from a to 1: 

(6.U) U(a) J a 4> a (y)dy = J" a A(0,y)<|> a (.y)dy 

the double integral terms vanishing because of the skew-symmetry of the 
kernel. Also, set y * a in ( 6 . 3 ). 

( 6 . 5 ) U(a) * A(o,a) - A(a,x)<|> a (x)dx . 

Divide (6.U) by / a 0 a (y)dy, let a —> aj , in case A(a,) * 1 , 
and use theorem (5-3)- There results 

lim U(a) - A(0,y)f (y)dy . 

a—>*a| J a a l 



A(0,y)f a 1 (y)dy i Ja, 


A(a,,y)f a ^(y)dy 


But 
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and this second integral Is zero since it is the negative of the corre¬ 
sponding quantity W in Case I, which was proved to be zero in Case I. 

This proves the second limiting relation. 

To obtain the third relation set a - o in (6.4) and (6.5) • The 
two integrals on the right-hand sides are then identical, and their elimina¬ 
tion gives 


U(o) 


A(0 »0) 


i + ; c i> 0 (x)dx 


There remains to establish the strictly decreasing character of 
U(a)We have by differentiation of (6.3): 


( 6 . 6 ) 


O'(a) = -A(a,y)$ a (a) + 


/a A(x * 


y) 


a<t> a (x) 

da 


dx 




U) 


da 


dx , 


a < y < i , 


which is independent of y in the indicated range. Again, obtain two 
expressions for U'(a), first by multiplying by 

*4> a (y) 

5a 

and integrating from a to 1, and second by setting y = a: 


fi C l 

U ' (a) J a 3a dy “ - V a) J a A(a ’ y) 

/i 


^ a (y) 

da 


dy 


U* (a) = -A(a,a)* a (a) 


WJx) 


dx 


The two integrals on the right-hand sides are identical, and their elimina¬ 
tion gives 


U* (a) 


-A(a,a)<|> a (a) 

" i f i »v y) ~ 

1 <t> a (a) ^a da y 


< o , 


y This is used below to establish the uniqueness of an optimal strategy, but 
a simpler proof is obtained in accordance with the supplementary remark at 
the end of the paper. The decreasing character of U(a) is then additional 
information about U(a). 
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since —jg — <0 as in Theorem 5• This completes the proof of the 
lemma. 

This basic lemma allows us to complete our discussion. In 
Case I, the lemma shows that U(a) < o for all a in the range 
a, < a < 1, and establishes the uniqueness of* the optimal strategy 
obtained in Case I. 

In Case II, under the supposition A(o,o) > o, we see from the 
lemma that there is a unique value of a which causes U(a) to vanish. 
This gives an optimal strategy and also establishes its uniqueness. 

There remains the case when A(o,o) = o, which is not yet 
covered by the lemma because of the unboundedness of the kernel. The 
following lemma completes the theory. 

LEMMA. If A(0,0) = 0, there is a positive a^ 

with A(a 1 ) = 1 . 

PROOF. Suppose that the lemma were false, so that A(a) < 1 for 
all a in 0 < a < 1. Formula (6.U) shows that U(a) < 0 since 
A(0,y) < o for all y > 0 because of A(o,o) = o. There Is therefore no 
solution of the game with a > o. But we have already established in a 
discussion near the beginning of $3, that a cannot be o in the case 
A(0,0) = o. There would therefore be no optimal strategy ana if we suppose 

that in this case an optimal strategy must exist, the resulting contra- 

8 

.diction would establish the lemma. 

We now give another proof of the lemma Independent of the general 
theory of games. Again suppose that the lemma were false, so that 
A(a) < 1 for all a in o < a < 1 . Take a positive £, and consider the 
game with the same kernel K(x,y) but with x,y limited to the range 
fc < x < 1 > £ < y < 1- For this range the whole preceding theory is valid 
since A( £,£) > 0. Also, the kernel in the new integral equation corre¬ 
sponding to (3*2) is the same, so that the eigenvalues are the same, but 
the term p(y) in (3*2) and (3*3) is now given by 


p(y) 


-A 2 (t,y) 

2A(y,y) 


O 

It is possible to show from very general considerations in the theory of 
games that in the present case, with A(o,o) * o, an optimal strategy 
exists. In these general considerations, difficulties occur at the end 

? pints 0,1. Here, no difficulties occur at o because of A(0,0) - o 
continuity at o), nor at 1 by the argument in Lemma 1 . 
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That is, all previous equations remain valid with 0 in the argument always 
replaced by the new lower limit £.. 

Let the solution of the game, corresponding to f(x) in ( 3 . 2 ) be 
Y e (x), with the values a £ , ^ of a and <*. We have 

f 1 Y (x)dx - 1 - A 
J \ l £ 


and since the corresponding W and U are zero, we have corresponding 
to (6.4) 

(6.Y) A(g,y)Y £ (y)dy = o 


and 

( 6 . 8 ) 


<* t A(£,1) + Ja A(x,1 )Y^(x)dx = 0 


corresponding to ( 6 . 3 ) with y = 1. From ( 6 . 7 ), since A(0,y) < 0 for 
y > 0, we see that a^ —> 0 as t —> 0. Select a fixed b > 0 so that 
A(b,l) < 0. We have, from ( 6 . 7 ) for sufficiently small 6, 


/ 


b 


A(£,y)Y £ (y)dy + 



A(fc,y)y £ (y)ay 


0 


or 


/ 


(A(e,y) - A(£,a t ))V £ 
= -A(£,a fc ) ( 1 - 


(y)dy + (A(e.y) - A(g,b))V £ (y)dy 

- Jb V £ (y)dy) - A(£,b)V £ (y)dy . 


The left-hand side is <0, while the right-hand side approaches 
-A(0,b) 11m /} Y*(y)dy which is > 0 unless the limit expression is 

c 0 ^ c* 1 

zero. Therefore lim J7 V c (y)dy = 0 . 

c - D £ 

From (6.8), we now tiave 


* fc A(£,1) lA(x, 1) - A(b,1))1f£(x)dx + A(b,1) (1 - «* £ - /i 


f b (A(x ’ 


1) - A( 1,1)) Y. (x)dx + A( 1 




(x)dx ■ 0 . 


Take the limit as £ —■) 0. All the integrals above except for the last 
are < 0, with Y^xjdx —> 0, and A(o,i) < o, A(b,1) < o. If 
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—•> d Q , 0 < & Q < 1, we see that the limit of the left-hand side of the 
above equation is definitely < o, contrary to the equation. This is a 
contradiction and the lemma is established. 

This completes the proof of the main theorem. 


$ 7. REDUCTION TO LINEAR DIFFERENTIAL EQUATIONS 

In a wide category of cases, the integral equation (3.2) is 
equivalent to a system of ordinary linear differential equations. This 
occurs if the function A(x,y) has the following special form: 

A(x,y) - PjUJq^y) . 


Set 


or 

(7-1) 


fy p ± (x)f(x)dx = § ± (y) , J y q^xJfUJdx - ^(y) 

£j(y) - -Pj(y)f(y) » £jO) = °» j = i» •••» n 

-< 

>l^(y) =» -qj(y)f(y) , >)j(i) - o, j = i, n . 


The integral equation becomes 

(7.2) 2A(y,y)f(y) - P ± (o)qj(y) - q£(y)(^ ± (a) - ^(y)) 

+ Xi li^y) • 


Temporarily set dp^o) + ^(a) ® c^, where c i are arbitrary coeffi¬ 
cients. Substitution of (7«2) into (7-0 gives a system of ordinary linear 
differential equations for gj(y), Yj(y)> depending linearly and homo¬ 
geneously on the parameters c^. The solutions of this system also depend 
linearly and homogeneously on c^. The equation 

c i * ^Pi^ 0) * $i< a) 

gives a system of n linear equations for the determination of c ^ in 
terms of a,d and the conditions (3*5), (3*7) then determine ot,a. The 
question of the unique solvability for the parameters is answered by our 
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main theorem, provided the monotonicity conditions of the theorem are 
satisfied. 


SUPPLEMENTARY REMARK 

The proof of the uniqueness of an optimal strategy can he given 
in a simpler form than presented in the body of the text. The existence of 
a solution is a consequence of the lemma in f 6, the uniqueness following 
from the decreasing character of U(a). Instead of the decreasing character 
of U(a), one can also use the following lemma: if there are two optimal 
strategies . they must have the same spectrum . This is proved as in the 
proof of Lemma 3. 


M. Shiffman 


The RAND Corporation and 
Stanford University 




REDUCTION OP CERTAIN CLASSES OP GAMES TO INTEGRAL EQUATIONS 1 
Samuel Karlin 

In this paper the solution of certain classes of games is reduced 
to the problem of solving associated integral equations. The games treated 
share the important property of a diagonal discontinuity in the payoff 
kernel or its derivatives and it is precisely this that leads to the inte¬ 
gral equations. In all but the final class considered the optimal strate¬ 
gies are unique. 

Part I deals with the general game of timing which was analyzed 
in the symmetric case by M. Shlffman [ 2 ]. In these games the diagonal 
discontinuity of the payoff (1 . 1 ) manifests the dependence of the result of 
a play on the order in which the players act; the optimal strategies are 
distributions which are (mainly) density functions, thus reflecting the 
lack of perfect information in these games. In the final portion of Part I 
the analagous game c$ perfect Information is considered as a limiting case. 

Part II examines payoff kernels which are concave on each side of 
the diagonal and which the discontinuity appears in the derivatives of the 
payoff. The optimal strategies obtained here are similar to those obtained 
in Part I. Several examples are given to Illustrate the general theory. 

PRELIMINARIES AND NOTATION 

We introduce some standard notation which will be used throughout 
this paper. The payoff kernel L(x,y) shall be defined on the unit square. 
The following strategy (- distribution) F = (ctl 0 , ply) shall mean 

that F has a jump of value d. at zero and a jump of value p at one 
while <|> ab (x) represents a continuous density function over the Interval 
[a,b] . Precisely, F(x) = ct + /* <t> ab (x)dx for 0 < x < 1 and 
F(l) * di + <|> ab + p = l . Whenever the notation <t> a is used then it is 

to be understood as <|) al . Finally [a,b] is taken to be the smallest 
interval outside of which (J> ab is identically zero. The spectrum of F 
shall include all points x for which every neighborhood of x has posi- 


^he preparation of this paper was sponsored (in part) by the Office of 
Naval Research and (In part) by the RAND Corporation. 
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tive F measure. The point spectrum of F shall consist of those points 
at which F possesses a jump. The jump of F at a point x Q shall he 

denoted hy 0 ' F. The definition of spectrum implies that the spectrum is 
x o 

closed. Similar notation shall he used for quantities associated with the 
0 strategy. 


PART I 


The kernel investigated in this section is of the following form: 


( 1 . 1 ) 


L(x,y) « •< 


K(x,y) 

$(x) 

M(x,y) 


x < y 

X * y 
x > y 


satisfying the following conditions: 

(a) The functions K(x,y) and M(x,y) are defined on x « y 
and have continuous second partial derivatives defined in the closed 
triangles x < y and x > y respectively. 

(h) The value li( 1 ) lies between K(1,1) and M(1,i) and 
So) lies between K(0,o) and M(o,o) while the value assigned to Sx) 
for 0 < x < 1 is bounded but otherwise arbitrary. 

(c) The most important requirement is that 


KjJx^) > 0 and M^x^) > 0 for x < 1 
Ky(x,y) < 0 and My(x,y) < 0 for y < 1 

(in their respective domains of definition). 

In particular, K and M, in their respective regions of defini¬ 
tion, are strictly increasing In x and strictly decreasing in y. 

A solution to the game defined by the payoff kernel L(x,y) is a 
pair of distribution functions F(x) and G(y) where 0 £ x < 1 and 
0 £ y £ 1 together with a real number v such that 

J*q L(x,y)dF(x) > v for all y and 

J q L(x,y)dG(y) < v for all x. 

If F(x) Is a strategy of the form (*I Q , ^(x), /®I-|), then the explicit 
expression for L(x,y)dF(x) reads, for 0 < y < 1 , 
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J*oL(x,y)dF(x) - <nK(o,y) + J^K(x,y) (f ab (x)dx + J*^M(x,y) $ ab (x)dx +/»M(l,y). 

It is of course understood that for y < fc the integral /£ K(x,y) $ ab (x)dx 
does not appear with a similar remark applicable to the integral 
/ b M(x,y) $ at) (x)dx for y > b. For y - o, cUC(o,o) must be replaced by 
*«§(o), and for y-l,/SM(l,i) by ^£l). • 

The procedure we follow will be to try to find a solution of the 
following form: an absolutely continuous distribution with continuous 
derivative on the interior of the unit interval with additional possible 
jumps at the ends of the interval. Such solutions will be exhibited and 
afterwards their uniqueness will be established. The following lemma serves 
only as a guide to the subsequent theory. It will not be explicitly used 
hereafter. 


LEMMA. 1.1. If both players possess optimal strat¬ 
egies of the form F - <P ab (x), ) and 

G = (*I Q , Y cd (y), cfl 1 ), then the form of the density 
is given by <t> ab - $ al and Y cd - Y al i.e., the spec¬ 
trum of the absolutely continuous part of both distri¬ 
butions begin at a common value 0 < a < 1 and extend 
to the upper end of the unit interval. 

PROOF. For any distribution of the type indicated above, we see 
that /q L(x,y)dF(x) is continuous and non-increasing for 0 < y < 1. If 
<|>(x) is zero in any interval, then / L(x,y)dF(x) is strictly decreasing 
in that portion by condition (c). Since F(x) represents an optimal 
strategy and c is in the spectrum of G, it therefore follows that the 
yield / L(x,y)dF(x) s v for c < y < 1, and hence that the spectrum of F 
includes the interval [c,l]. A similar argument applies to G and we 
establish that c = a. 


THE MAIN THEOREM 

The main theorem of Part I deals with a complete description of 
the optimal strategies for the payoff kernel (1 .1). Unfortunately, many 
different type of solutions may occur depending upon the nature of K(x,x), 
M(x,x) and the values of L(x,y) at the extreme points of the unit square. 
It Is therefore necessary to present a mutually exclusive classification of 
the various possibilities. The analysis of the kernel L(x,y) of (1.1) 
subdivides into three main parts. In the case where there exists an x Q 
such that K(x 0 ,x q ) * M(x 0 ,x Q ), then the type of optimal strategies that 
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appear occur under the headings of B, C and D of Theorem 1 . More precisely, 
the essential feature is to study the spectral radius A(a) and /t(a) of 
the two integral equations (1.2) and ( 1 . 3 ) given below. The type of solu¬ 
tions as described in B, C, and D always appear when either A(a) >1 or 
Mi a) >1 for some a In the unit interval. Furthermore, If 
X( x 0 *x 0 ) - #(x 0 ,x 0 ) for some x Q with 0 < x Q < 1, then it follows that 
both A(a) > 1 and a) > 1 for some a in the unit interval. The 

second and third parts of Theorem 1 suppose that both K(x,x) > M(x,x) for 
0 < x < 1 and A(0) < 1 and /<.(o) < 1 . They are distinguished by the 
assumption of K(o,l) < M( 1 , 0 ) and K(o, 1 ) > M( 1 , 0 ) respectively. In 
both cases the value 5(0) plays a very fundamental role. 

The statement of the theorem to be established in Part I is 
summarized in the following array: 

THEOREM 1.1. The optimal strategies for the pay¬ 
off kernel (1 .1) are unique and are enumerated In the 
following table: 


Kernel 

Optimal F 

Optimal G 

A K(1,1) < M( 1 ,1) 

h 

h 

K(x,x) > M(x,x), a < x < 1 

<*a> 

JI,) 


B 

A(a) - 1 >i(a) < l 


K(x,x) > M(x,x), a < x < l 

C 

A(a) - 1 /x(a) - 1 

(V 

(y a ) 

K(x,x) > M(x,x), a < x < 1 

D 

A(a) < 1 Ma) = 1 

<♦>' /*v 

(y a ) 

If K(x 0 ,x 0 ) = M(x 0 ,x 0 ) 
for some o < x Q < i 

B, C, or D 

B, C, or D 


K(x,x) > M(x,x), 0 < x < 1 
A(o) < 1 m(o) < 1 
K(0,1) < M( \ ,0) 


*o> 


<V 0 , *1,) 


E 5(o) « K(o,o) 
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Kernel 

Optimal F 

Optimal G 

F 

s 0 < 5 ( 0 ) < K(o,o) 

<«o' ♦a 5 

( (ri 0' V 'V 

G 

5(o) = S Q 

*a> 

<«o* V 

H 

M(o,o) < 5(o) < S 0 

(*I 0 , 4> a , /3I, ) 

<»V V a) 

I 

M(o,o) = 5(o) 

(♦o' P 1 ^ 

(«o» V 


K(x,x) > M(x,x)* 0 < x < 1 
A(O) < 1 jx( o) < 1 
K(o, 1) > MO ,0) 


J 

K( 0 ,1) 

> 5(o) > MO ,o) 


J o 

K 

K(o,0) 

> 5(o) > K(o,i) 

O' V 

("o* V <^ I 1 ) 

L 

K(0,0) 

= So) 


(Y 0 ,rfl,) 

M 

M(1,o) 

> Ko) > M(o,o) 

Wo' V 

(«o* T a ) 

N 

5(0) = 

M(o,o) 

(♦o' ^ 3I 1 ) 

UI 0 , Y 0 ) 


Furthermore, the densities 0 ana Y 

are obtained as the solu 


tion to certain integral equations. These solutions are either Neumann 
series or eigenfunctions of integral operators. 

The proof of this theorem shall be divided into a series of 
lemmas. The aim of the first series of lemmas. Lemma 1.2 - 1.16 is purely 
to show the existence of the solutions indicated in the shorthand of 
Theorem l.i, in the various cases A through N. The uniqueness question 
is settled by Lemmas 1.17 - 1.20. 

LEMMA 1.2. If K( l , 1) < M( 1 ,1), then the point 
(M) is a saddle point of the kernel L(x,y) . 

PROOF. The statement is an immediate consequence of conditions (b) 

ana (c). 
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THE INTEGRAL EQUATIONS 


On account of Lemma 1.2 ve can suppose In all that follows that 
K( 1 ,1) > M( 1 , 1 ). The continuity of K and M provides a non-empty inter¬ 
val a < x £ 1 for which K(x,x) > M(x,x). We introduce now the following 
integral equations: 

Let 

(1.2) f(^) - J ^ T(x,^)f(x)dx - <tp, (^) + /3P 2 ($) 

where 


T(x,|) = 



-VM> 


Pi (%) 


-y<M) 


p 2 q) = 


a < x 1 % 


a < ^ < x < 1, 


and d. and fi are constants. 

For convenience, we denote this equation by 
(I - T a )f * ocp-j + /9p 2 , I being the identity operator and T a denoting 
the Integral operator defined by the kernel T(x,$) and lower limit a. 
Let 

(1.3) g(>|) - 

where 


Ja W>7,y)g(y)cly = + <fq 2 (*j) 


and 


U(^,y) 


< 


Wtll 


a < y < ^ 


T< y < 1 


q,( ? ) 


M^o) 




q 2 (fj) 




Kty,7j)-M(>j,vj) 


Again, we denote this equation by (I - U a )g * fq^ + fq 2 « The Banach space 
upon which these operators T a , U & act shall consist of all continuous 
functions defined on the interval a £ x £ 1 . Whenever a function f in 
the domain of T a Is considered on an interval extending beyond a £ x £ 1, 
then it is to be understood that f is taken to be zero outside of 
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a £ x < 1 . Equations (1.2) and (1.3) are considered over an interval 
[a,l] in which K(x,x) > M(x,x) . Consequently, the operators T & and U a 
are strictly positive completely continuous operators. We enumerate some 
of the properties of such operators. 

I. If A(a) denotes the radius of the smallest circle containing’ 
the spectrum of T a , then A(a) is an eigenvalue and has a unique positive 
eigenfunction solution. The strict positivity guarantees the uniqueness. 

II. The quantity A(a) is a monotone continuous function of a? 

When a —-> 1, then A(a) —> 0. The eigenfunction solution f converges 

uniformly for any preassigned *) on a + r\ < x < 1 to f as a tends 

i a o 

to a Q . 

III. Finally, If X> A(a), then ( 1-4 TJ' 1 exists and Is 

T n A a 

given by Sn=0 • This series applied to a continuous function con¬ 

verges uniformly on the Interval [a,i]. This series representation for 
T , 

the operator (I - -j-) defines thus a strictly positive transformation 
which maps continuous positive functions into strictly positive continuous 

T a -1 

functions. In addition, (I - -j^) varies continuously with a in the 
sense described in II provided that A > A(a) + £ Q . Similar results apply 
to the operator U a - There we employ the notation of ju.( a) in place of 
A(a). 

The results enunciated above are deduced elsewhere as special 
applications of a general theory of positive operators developed by F. H. 
Bohnenblust and the author [1]. We shall employ them throughout the re¬ 
mainder of this paper. 

Case B. C, and D . 

LEMMA 1.3. If there exists an x Q with 
° < x Q < 1 and K(x o ,x q ) = M(x 0 ,x Q ), then there exists 
an a > x Q such that A(a) = 1 . Similarly, a* > x Q 
exists with /a( a*) = 1 . 

PROOF. We treat only the case Involving A(a) = 1. Let x Q de¬ 
note the largest x for which K(x,x) = M(x,x). Therefore, for x Q < x £ 1, 
we have K(x,x) > M(x,x). Furthermore, let f Q (x) with a > x^ denote the 

cl O 

eigenfunction associated with T a and A= A(a). Let £. > o be chosen so 
that x rt < 1 - £. For a such that x 0 < a < 1 - E, we may assume f Q 

^ 1 —P ^ ” 

has been normalized so that / a f a (x)dx * 1. 

Now by condition (c) there exists a k > 0 for which 

-Ky(x,y) > k, x < y < l - 

-My(x,y) > k, y < x £ 1 - fc. 



152 


KARLIN 


so that, for 
o < k - k 


x o < a £ T £ 1 ' *■ 

Ja~ e f a (x)dx 1 J'l _ Ky(x,»|)f a (x)dx + - My(x,»))f a (x)dx 

< J*2 - Ky(x,»j)f a (x)dx + J*i| ’ My(x,»j)f a (x)dx . 


But since T ft f & - Af a , this last expression is [K(^, rj) - 
f^(>l)A(a), so that 


(i.*) 


o < 


k 


< A(a)f a (»j) . 


Since the partial derivatives of K and M are hounded we have a constant 
C for which 


K (.rf.tf) - K(.tj,rf) = [K(>j,>j) - 

Consequently, o < < A(a)f a (>y), 

yields 0 


- tK(x 0> x 0 ) - M(x 0 ,x 0 )] < C(>f - x Q ) . 
and Integration over (a, 1 - €.) 


k ' JV £ 5p^ d 7 < A(a) Jf* 1 a (> f )d ’| - M&) ■ 

Hence A(a) becomes unbounded as a tends to x Q , and since A(a) —> o 
as a —v> l , by Property II we have an a j*or* which A(a) «= 1 . 


LEMMA 1.4. Under the assumption of Lemma 1 .5 there 
exist optimal strategies for both players of the form: 
an absolutely continuous distribution over an interval 
[a,1] with a possible jump at 1 for one of the 
players. 


PROOF. Lemma 1 .5 implies the existence of an a (a > x Q ) for 
which either A(a) = 1 and yu(a) < 1 , A(a) = 1 and yn(a) « 1, or 
A(a) < 1 and /*.(a) - 1 . We begin with the first case. Since A(a) - 1 , 
we obtain a 4> a (x) > 0 normalized by ^a “ 1 ^ or T a <|> a " ^a* 

This Implies that 

(1 . 5 ) u(a) = J"a K(x,yH> a (x)dx + M(x,y)i(i a (x)dx for a £ y £ 1 

where u(a) is a constant depending only on a, since differentiation of 
equation ( 1 . 5 ) yields precisely the relation T a d a - <f> & . If we consider 
$_(x) extended beyond the interval [a,i] so that <t Q (x) « 0 elsewhere, 
then on differentiating the right-hand side of ( 1 . 5 ) we obtain, in view of 
condition (c), a negative value when 0 £ y < a. Thus the expression 
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/I L(x,y)<t>_(x)dx > u(a) for o < y < a by virtue of the continuity of 
this integral. Moreover, as >u(a) < 1, according to Property III we can 
write (I - U a )''q 2 = f 2 with Y s > o. Let f' & V 2 (y)dy - c. Define 
d = -j-U ao that / <fV 2 (y)dy = t - . Put Y & ( y) - </1K 2 (y). The equation 

(I - U a ) y a = <fq 2 becomes on integration 

(1.6) w(a,J) «cfK(x,l) + M(x,y) Y^(y)dy + K(x,y) y* a (y)dy 

for a < x £ i . 

An analysis similar to that applied to equation (1.5) shows that 
/ a L(x,y)dG(y) < w(a,«J) for o < x < a where G(y) = (V^dT,) . Integra¬ 
tion of (1 .5) with respect to G and (1 .6) with respect to P now yields 

u(a) = w(a) = v. This establishes the proof for the case A(a) = 1, 

>u(a) < 1 . A symmetrical argument can be applied to the case A(a) < 1 , 

ju(a) » 1 . Finally, when A(a) = >u(a) = 1 both the solution and proof are 

simpler. Both players use only absolutely continuous distributions which 
are the eigenfunction solution to T a <P a = <t> a and U a V^ - Y a » The details 
of this case are a straightforward adaptation of the arguments already 
given. 

In the future we may assume that K(x,x) > M(x,x) for 0 < x < 1 . 
The operators T a and U a may be now considered for any a in the unit 
interval. 

LEMMA 1-5* If there exists an a for which either 
)y(a) or yu(a) = 1 with 0 a < 1 , then Case B, C, or 
D occur with optimal strategies existing of the form 
indicated In Theorem 1.1. 

PROOF. Since A(a) and m( a) tend monotonically to zero as a 
tends to one, by virtue of the hypothesis it is clear that there exists an 
a' with either A(a*) - 1 /^a') < 1 , A(a') = /^a') = 1 , or 
A(a*) < 1 /A(a*) = 1 . The remainder of the proof follows as In Lemma 1.4. 

A(Q) < 1 , >i(o) < 1 , and K(o,i) < M(l f O) . This section con¬ 

siders the case where A(o) < 1 Mi°) < 1 and K(0,l) < M(1,0). These 
conditions also imply that K(x,x) > M(x,x) for 0 < x < 1 , by Lemma 1 . 3 . 
Since A(o) < 1 and > 1 ( 0 ) < 1, we can form (I - T & )and (I - U a ) -1 
for every a with 0 < a < 1 and, in view of Property III, these operators 
transform positive continuous functions into strictly positive continuous 
functions. Furthermore, as a —> 1, then (I - T Q ) _1 p = <|> 0 —> p and 
hence / a <t> a —•> 0 . An analogous remark applies to (I - U & ) . If we 

set (I - T^) - ^ - ^ for i - i, s, then (I - T a ) -1 (<*p, + ^p 2 ) - 
+ /9$ 2 - $i a . Let us choose o(. and fi non-negative satisfying 
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dL/l t, + /*/ a <|> 2 - 1 - d. - fi, so that F * ^o^a’^ 1 ! * ls a strate gy- 
Now 

(x)dx + J^M(x,y)<|> a (x)dx 

for a < y < 1 (where u( a ;<*,,$) is independent of y), since differen¬ 
tiating this expression with respect to y yields e^p 1 + fip 2 « (I - T a )4> & . 
Moreover, in view of condition (c) we have, for* o £ y < a, 

0-7a) u(a;ot,^) < <*K(0,y) + ^M(l,y) + J* a M(x,y)<|> a (x)dx 

so that u(a;cL,/3) < / L(x,y)dP(x) for o < y < 1 . 

Similarly, if we set (I - U a )” 1 q jL - i = i, 2, and choose 

y, > 0, satisfying * / a + <f / a Y 2 - 1 - JT - <f, we have for 

*a ” + ^2 that G = ^ YI o ,1fr a , ^ I i ^ is a strate gy and 

(1.8) w(a;V,<f) - *M(x,o) +cTK(x,1) + 

for a < x < 1; and again in view of (c), 

vU;*,/) > STM(x,0) +<nc(x,1) + K(x,y)r a (y)dy 

for 0 < x < a. Consequently w(a;y,of) > / L(x,y)dG(y) for o < x < 1 *. 

We now have available the five parameters ct, /S , y, and a 
(subject only to the conditions ct, fl, y, > 0, o < a < 1, 

*/i*i '/a^ + ‘ W> 

which, as we shall show in this and the following section, may, in each of 
the remaining cases of Theorem 1 .1, be chosen to insure the following con¬ 
ditions: 


a M(x,y)^(y)dy + 




x K(x,y)^(y)dy 


(1.7) u(&;et,/$) - *K(0,y) +^M(1,y) + 


JlKCx, 


y)0 fl 


u(a;<*,/$) = w(a;y,J’) 

/ L(o,y)dG(y) and / L( 1 ,y)dG(y) < w(a; 1,f) 

/ L(x,0)dP(x) and /L(x,1)dP(x) > . 

When these conditions are fulfilled we shall evidently have, for all x 
and y, 

J*L(x,y)dF(x) > u(a;ct,^) » v - w(a;y,<f) ^ J*L(x,y)dG(y) , 
I.e., that (F,G) is a solution. 



REDUCTION TO INTEGRAL EQUATIONS 


135 


In the remainder of Part I it is to be understood that in writing 
u(a;cd,/S) we tacitly assume that fi y_ o, o < a < 1 and 
oif^ ^1 + P ^a ^2 " 1 ’ * “ We note s P ecif ically that we may always 
take eL (or fi) to be zero, and that then fi « (1 + ♦g)" 1 is a con¬ 
tinuous function of a. We may also require oL and p to have a fixed 

ratio r, o < r < + oo, in which case u(a;oL,r ) is a continuous function 
of a. Similar remarks of course apply to * and cf. 

LEMMA 1.6. For any ratio r there exists an a 
for which u(a;ot,o) = w(a;y,rar). Similarly there exists 
an a' for which u(a';ci,r<*} = w(a*;y,0). 

PROOF. If in (1 .7) and (l.8) we set x = y = 1, then for any 
O 0 and a sufficiently close to 1 we have 

Majd./S) - [*K(0,1) +/3M(1,1) + ( <' a )K(1,1)]| < e /3 

|w(a; K,<f) - [m(l ,0) +<TK(1,1) + < JI V M( 1 ’ 1 > 1 1 < */3 • 

Since /1 <|) 0 and /1 Y fi —> o as a —> 1 , we conclude that for a 

a a a cl 

near 1 

|u(a;d.,/3) - w(a;l r,<f) - (H-K(0,1) + /8MOO) -VM(l,o) - 1 ,1)} I < £ , 

for any appropriate values of <*,/$,£, cf- Now by assumption 

K(0,1) < M( 1,o) and M( 1,1) < K( 1 , l) while monotonicity implies that 

K(0,1) < K( 1,1) and M( 1,1) < M( 1,0). Since 

1 - d. - /3= 4>, + fifl $ 2 


and 

* s/L % 

both tend to zero as a —> 1, we have clearly 

cHK(o,i) -»- /3M( 1,1) - *M(1,0) - <TK(1,D < 0 

for a sufficiently close to 1, for any appropriate values of ot, fi, X, cT. 
Consequently u(ajct,/3) - w(ajaf,«f) < o for a near 1 . 

*Here we make the convention that u(a;rt,«.dO « u(a;0,/$). 
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Let us now substitute the values a - 0, x - o, and a ■* o, 
x - 1 in (1 .8); similarly set a - 0, then let y —> 0 and a - 0, and 
then let y —> 1 in (1 .7)* We obtain the equations 

(1.9) u(0 }d.,/3) -«.K(0,0) + /3M( 1,0) + J^ M(x,0)i|> o (x)dx 

(1.10) vfOjir,,/) - JfM(0,0) + cfK(0,1) + \ K(0,y)y o (y)dy 

r 

(1.11) u(0 }A,/3) -*K(0,1) +/JM0.1) + l K(x,1)<|> 0 (x)dx 

( 1 . 12 ) w( 0 ;K„f) -m( 1 , 0 ) + K( 1 , 1 ) + j' Q M(1,y)r 0 (y)ciy • 

Also, if we multiply (1 ■'() by y 0 (y) and integrate we obtain 

(1.13) (1 - y - cf)u(0;<*.,/?) - *J^ K(0,y)y o (y)dy + fiJ' Q M( 1 ,y)f 0 (y)dy 

+ Jo Jo L(x,y)«|) 0 (x)r o (y)dxdy . 

Similarly, multiplying (1 .8) by <p Q (x) and Integrating we obtain 
(1.H) (1 - ol - /3)w(0jir,/) - y J^ M(x,0)<u o (x)dx + <f Jq K(x, 1 )<|> 0 (x)dx 

+ Jo Jo L(x,y)$ 0 (x)>^(y)dxdy . 

Multiplying (1.9), (1.10), (1.11), and (1.12) by |f, <k, cf, and' 

/5 respectively and eliminating the integrals yields finally 

(1.15) u(0 - w(0 5 r,rf) - ctf[K(0,0) - M( 0,0) ] + /W*[M(1,1) - K(1,1) ] . 

Now if either (3 or is zero, say fi, we have u(0;*,o) - w(0;lT,cf) > o 
since K(0,0) > M(0,0) . Since u(a;ot,o) - w(a;y,r!T) is a continuous func¬ 
tion of a, the conclusion of the lemma is evident. We note for further 

use that (1.15) does not depend on the assumption K(o,i) < M(i , 0 ). 

LEMMA. 1-7* Statement E in Theorem 1 . 1 . 

PROOF. If in (1 . 7 ) and (1.8) we set fi » X » 0, then (1 15 ) 
shows that u(0;ct,o) « w(0;0,cf) - v. Consequently, we have only to show 
/ L(x,o)aF(x), / L(x,i)aF(x) ^ v ana / L(o,y)dG(y), / L(l,y)dG(y) < v, 

where F - (*I 0 >4> 0 ) and G - (V Q ,Ii). The assumption 1(0) * K(o,o), 
implies / L(x,o)dF(x) - v, and since fi - 0 , / L(x,l)dF(x) * v. 

Similarly since * - 0 , / L(o,y)dG(y) - v, and 

JliO ,y)dO(y) -JfO) + Jj,M(i ,y)V 0 (y)dy £ <fK{i ,1) + J^MO ,y)^(y)dy - v 
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In a similar manner one can establish 

LEMMA 1.8. Statement I in Theorem 1 .1 . 

LEMMA 1.9* There exists a value S Q with 
M(o,o) < S Q < K(0 ,0 ) for which $(0) - S Q implies the 
existence of optimal strategies of the form indicated 
in Case G of Theorem l.1. 


PROOF. We take fi = = o, and abbreviate u(a;*,o), w(a;*,o) 

by u(a), w(a). Lemma 1.6 implies the existence of an a for which 
u(a) * w(a), and (1.15) Implies a > 0. Consequently 
/ L(x,y)aG(y) < v = w(a) for 0 < x < a and / L(x,y)dF(x) > v for 
o < y < a, where F = (oll 0 ,<|> a ), G = (tfl^^). Since £ « cf - 0, we have 


f 


L( x, 1 ) dF (x) 


v 


/ 


L(i,y)dG(y) • 


Now 


J L(x,o)aF(x) = *$(o) + J ^ M(x,o)^ a (x)dx , 
and (1.7a) implies 

v < <*K( 0 , 0 ) + J" a M(x f o)$ a (x)6x . 

If $(0) = M(o,o), since we then have 

v > JTM( 0 , 0 ) + J'a K(0,y)V* a (y)dy = J*L(0,y)dG(y) , 
and <0 o, we obtain // L(x,y)dF(x)dG(y) < v, or 

y /q L(x,o)dF(x) + / a /^ L(x,y)aF(x)r a (y)dy = IT L(x,0)dF(x) + v(l-20 < v 

or /q L(x,0)dF(x) < v. Hence for some value S Q , M(0,0) < S Q < K(0,0), 
for 1(0) we have J ] Q L(x,o)dF(x) = v. This in turn inplies 
/q L(0,y)dG(y) = v since then 

v ■ !(/>< x,y)dF(x))aG(y) = * J ] Q L{0 ,y)dG(y) + J^^J*QL(x,y)dG(y)^<|) a (x)dx 

- cL^L(0,y)dG(y) + (1 - d)v . 

It is assumed in the next lemma that the value a Q of a used 
in Lemma 1.9 is the least a for which u(a;oL,o) * w(a;r,0). Hence for 
0 < a < a Q we have u(a;cx.,o) > w(a;2T,o). 
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LEMMA 1.10. Statement P in Theorem 1.1. 

PROOF. The function f defined by 

f(a) « ^ [u(a;*,0) - M(x,0)<|> a (x)dx] , 

where « (1 + /^ ) -1 , is continuous. By (1.9) f(o) = K(0,0), and as 

we have seen in Lemma 1.9, f(a ) - S Q . Consequently, if 
S 0 < $(o) < K(0,o) there exists an a, o < a < a Q , for which f(a) = $(0), 
or, for P - (^Iq,^), 


Jux, 


o)dF(x) - <tf(o) + 


M(x,0)(|) a (x)dx - u(a;*,o) . 


Since fi =* o, we also have / L(x,l)dP(x) = u(a;ot,o). 

In view of the remark preceding this lemma, u(a;ot,o) > w(a;tf,0) 
for this a. However, taking JT = o and G = (V / ' a ,/I 1 ) yields 

u(a;ot,o) « L(x,y)dF(x) )dG(y) 

= L(0,y)dG(y) + A fi L(x,y)dG(y) <> a (x)dx 


L(0,y)dG(y) 


+ (1 - cL)v(a;0,'S) 


Since 


Ju», 


y)dG(y) = K( 0,1) + 


/>»■ 


y)Tl(y)dy < w(a;0,cf) , 


we must have u(a;ol,o) < w(a;0,</). Clearly then there exists y, > 0 
for which u(a;ot,o) * w(a;y,<rt = v. 

We shall now verify that P « ^o^q) ^ G(yi 0 ,V a ,oTI 1 ) are 

optimal. We already have 


/ 


L(x,0)dP(x) 


J L( x, 


DdP(x) = v . 


Nov 


J’LO.y)dG(y) -JTM(i,o) + <f§(i) + M(i ,y)<K a (y)dy 

< WO. 0 ) + cTK( 1,1) + J a M(l,y)y a (y)dy - v , 
and since v - I' 0 Uq L(x,y)dP(x))dG(y), 

v - cej^ L(o,y)dG(y) + (1 - «l)v 
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so that / L(o,y)dG(y) - v, and the proof is complete. A similar proof 
yields 

LEMMA 1.11. Statement H of Theorem 1.1. 

A(Q) < 1, Mo) K 1 * &nd K(0,1) - M( 1,0) ^ 0. It remains only to 
consider the case where K(o,l)-M(l,o)>o. If M( 1 ,o) < $(o) £ K(o,l), 
then it is easily verified that a saddle-point exists at (o,o). This 
establishes 


LEMMA 1.12. Statement J of Theorem 1.1. 

LEMMA 1.13. Statement L of Theorem 1.1. 

The proof of this proposition is identical with the argument of 

Lemma 1 . 7 . 

In a similar manner to Lemma 1.8, we have 

LEMMA 1.14. Statement N of Theorem 1.1. 

LEMMA 1 . 15 . Statement K of Theorem 1.1. 

PROOF- If we set /S = y = a = 0 in equation (1 . 7 ) we obtain 

u( 0 ;d,o) = otK(o,o) + J ] Q M(x,o)<|> 0 (x)dx; 

consequently the continuous function f defined by 

f(a) = ^ [u(a;ot,0) - J } Q M(x, 0 )$ a (x)dx] , 

where <*. * (1 + / a has f(o) = K(0,0). Inserting the values 

= 0, y = 1 in (1.7) yields 

u(a;d, 0 ) =otK( 0 ,l) + J* a K(x, 1 )<J> a (x)dx , 

so that 

f(a) « K( 0 , 1 ) + 5 - (K(x,l) - M(x,o))<t> a (x)dx . 

As a —> 1 , ol —> i, and the integral in this last equation tends to zero, 
so that f(a) —> K(0,1). Hence if K(0,1) < 5(0) < K(0,0) there exists 
an a, 0 < a < 1 , for which f(a) = 5(o), or 
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u(a;rt.,o) « *5(0) + Ja M(x,0)<t> a (x)dx = j L(x,0)dP(x) 

\ 

where P - (<*I 0 ,$ a ). Since fi - o, / L(x,i)dF(x) = u(a;*.,o) also. 

Now for this same a let G * (^I 0 iY a )# where y - (l + /^V,) -1 
Since / L(x,y)dF(x) « u(a;*,o) for a < x £ 1 and x « o, we have 


0 .16) 


J*L(x,y)dP(x)) dG(y) 


u(a;*,o) . 


On the other hand 


(1.17) JY Jl,(x,y)dG(y) ) dP(x) - ,y)dG(y) + (1 - d)w(a;r,o) 


and 

(1.18) J*L(0,y)dG(y) = ar$(o) + J^K(o,y)r a (y)dy > *M( 1 , 0 ) + J" a M( l ,y)r a (y)dy 

since 5(0) > K(0,1) > M(1,0) and K(o,y) > K(o,l) > M(l,0) > M(1,y). By 
(1.8) (with <f * 0 and x - l) the last quantity in (1 .18) is w(a;*,o), 
so that combining ( 1 . 16 ), ( 1 . 17 ), and ( 1 . 18 ) yields u(a;d,0) > w(a;Jf,o). 

However taking V ® o produces the inequality 
u(a;*,0) < w(a;0,cT), for if G * (^,^1^ then 


u(a;*,0) = x,y)dP(x)dG(y) = d/L(o ,y)dG(y) + d - oL) w (a;O iC f) 

- <*WK(0,1) + jY K(0,y)^(y)dy) + (1 - d)w(a;0,d») 


< *w(a;0,eP) + (1 - ct)w(a;0,cT) = w(a;0,cfl . 


Since the two extreme choices of Jr and cP yield opposite inequalities 
there exists a pair of values if and «P for which u(a;d,o) = w(a;lf,«r). 
The verification of the optimal nature of the strategies P = (<*l 0 ,<|> a (x)) 
and G - OfI Q ,Y a (y) ,J*I 1 ) is now straightforward and similar to the last 
part of the argument in Lemma 1 .1 o. 

LEMMA 1 . 16 . Statement M of Theorem 1.1. 


PROOF. Similar to Lemma 10 . 

Uniqueness . The optimal strategies of the specified types have 
now been exhibited and there remains only the question of uniqueness. In 
Cases A and J it is easily verified via condition (c) that the solutions 
.are unique. Prom the remaining cases we shall select Case (P) as typical, 
and show uniqueness in this case. Any other case can be handled similarly. 
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LEMMA 1.17- If F represents any optimal strate¬ 
gy for player I, then the spectrum of P on the in¬ 
terior of the unit interval is continuous. 

PROOF. Since we already have an optimal strategy 
G * (yi 0 »Y a »cfIj) for Player II for which / L(x,y)dG(y) < v for 
o < x < a, the spectrum of P must be confined to the Interval [a,i] 
and the end point 0. Consider any y Q with a < y Q < 1; then 
/ L(x,y 0 )dP = v while / L(x,y)dP(x) « v for a neighborhood of y Q . By 
bounded convergence, we get 

llm C L(x,y)dF = f Lfx.y^dF » v . 

y-»y 0 + J J 

Similarly / L(x,y“)dF(x) = v. The difference gives 

[K(y 0 .y 0 ) - M(y 0 ,y 0 )] <r y F - 0. As K(y 0 ,y Q ) > M(y Q ,y 0 ), we have 

o' P = 0. The case where y = a can be handled similarly. In fact, one 
y o 

has [<()(a) - K(a,a)] r a P = 0 and [0(a) - M(a,a)] o^F < o. Since 
K(a,a) > M(a,a) we deduce from these two relations that <r a F = o. 

LEMMA. 1 . 18 . Under the conditions of Lemma 1.17, 
then F is absolutely continuous for a < x < 1 and 
F* = f is continuous. 


PROOF. By virtue of Lemma 1.17, we know that F = (oO; o ,F 0 (x) ,yfll 1 ) 
and the spectrum of F Q is continuous and confined to a £ x < 1 . Also, 

(1.20) J’L(x,y)dF(x) = «K(0,y) + L(x,y)dF 0 (x) +ySM(l,y) 

for a < y < 1 . An integration by parts furnishes with the aid of the 
continuity of F Q for this interval that 

(1 -21) f L(x,y)dF 0 (x) = Jy K^dx + M x F Q (x)dx 

+ [K(y,y) - M(y,y)] F Q (y) + c . 

On account of K(y,y) > M(y,y), this equation and (1.20) show that F Q (y) 
is absolutely continuous. Upon differentiation of (1.21), one finds that 
F Q = f is also continuous for a < x < 1 . 

LEMMA 1.19- The optimal strategy for player I is 
unique. 
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PROOF. Since we are considering Case (F), we know that optimal 
strategies of the form F « («H Q ,<|> a ), G - ) exist with S / o, 

a < 1 . By the preceding lemmas, any other optimal strategy F* for 
player I has the form F* - (ot 1 1 0 ,F Q ,^ 1 1 1 ), where F Q is absolutely 
continuous. Is confined to the interval [a,l], and has a continuous 

derivative F Q • f on a < x < 1 • Now /3 } must be zero, for if not, then 

v - L(x,1)dF*(x) - *^(0,1) + ^10) + J"a K(x,1)dF Q (x) 

V - Jq L(i ,y)dG(y) - 1TM(i ,o) + <f§0 ) + J } & M(i ,y)Y a (y)dy 

since both <f and py are non-zero; on the other hand 

v - *^(0,1) + y9,MO,l) + K(x,i)dP 0 (x) 

v - JTM(i,o) + (fK( 1 , 1 ) + J*a M(i ,y)r a (y)dy 

by continuity. But the first and third equations imply $( 1) * M(l,l) and 

the second and fourth $( 1) « K( 1 , 1), which is impossible since 
K( 1,1) > M(l,l). 

Thus we see that f - F Q satisfies the integral equation (1.2) 
with fi ** o, and since the solution of this equation is unique (<* is 
uniquely determined by / $ a • 1 - oO, we must have F* = F. 

LEMMA 1.20. The solution for player II is unique. 

PROOF. In a similar manner it is easy to deduce that the form 
of any optimal strategy is G = 0Tl o ,^(y) ,<fl 1 ) with Y a (y) a density 
function for a ^ y < 1 . It follows that and are determined by 

/ Y a - 1 - » - and K<|>(0) + / a K(0,y)Y a (y) + cfK(0,1) * v where 
Y & " + ^2* s °l ution to these equations were one dimensional, 

then there would exist a solution with If « o, ef > o. But the monotonicity 
criteria yields that 

Ja K(°,y)Y(y) + <fK(o,i) < v 

which is a contradiction. Thus the solution of the above linear equations 
is unique. This immediately implies the conclusion of the lemma. 

PROOF OF THEOREM 1.1. Lemma 1 .2 to Lemma 1.20. 

Additional remarks . 

A. If K(x,y) and M(X,y) are both separable functions 
(K(x,y) - i*i(x)s 1 (y) etc.) then It can be shown that the integral 

equations producing the continuous portion of the optimal strategies may be 
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replaced by differential equations. 

B. If the kernel is symmetric i.e., K(x,y) » -M(y,x) and 
§(x) « o, then the only type strategies that appear are (A), (C), (G) 
or (J) • 

C. If K xx , M^Xjy) < 0, K^x^) > M^(x,x), and 

K'ii},*!) > M'(>7,^) then the transformation U a transforms positive con¬ 
tinuous functions into continuous monotonic decreasing functions. Indeed, 
we differentiate 


U a g 


/; 


Wbl > 




g(y)dy 


/; 




1 -H(.rj,yj) 


g(y)dy 


getting 


—^-- j /KxS + ♦ [M 3 t (^). Kx O J ^)]g(r ? )j 


OM^g + i^g) 


[K'(Y^) - M' (>7,7) ] 


The hypothesis clearly imply that ^(U a g) < 0. Since U a g is continuous 
and positive, we thus deduce that the optimal Y a (y) is positive con¬ 
tinuous and decreasing. In fact, Y a (y) = £ n=0 U a q ea °h term of which 
has the desired property. 

In order to insure that the optimal <tL(x) shall be positive and 
decreasing it is sufficient to assume that Kyy > o, My y >0, Ky(y,y) > 
My(y,y) and K' (£,f) > M'(f. 

An example where these conditions are fulfilled is 


L(x,y) 


r K(x,y) - x - (1 - x)y 
-< §(x) = o 

^ M(x,y) = -y + (1 - y)x 


x < y 


x > y . 


Thus, one can conclude that the absolutely continuous part of the optimal 
strategy for either player for this kernel is continuous and decreasing. 

In this particular example the absolutely continuous distributions consist 
of inverse cubics. 

Many other such examples can be constructed. 

D. We remark that if all the Inequalities In condition (c) are 
reversed, then the form of the optimal strategies are obtained by inverting 
the unit Interval. (Replacing x by 1 - x and y by 1 - y.) 

E. Concerning the statements E to I of Theorem 1, some informa¬ 
tion can be given about the change of the interval [a,l]. Implicitly 
contained in the proof of Theorem 1 is the fact that as $( 0 ) traverses 
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the range from K(0,o) to S Q to M(o,o) the point a increases from o 
to a maximum value a Q < 1 and then decreases from a Q to o. In a 
similar manner it can he. shown that pertaining to statements J to N as 
Ro) traverses K(o,o) to K(o,i) to M(l,o) to M(o,o), then a in¬ 
creases from o to 1 remains at 1 while M(i,o) < Ro) < K(o,l) and 
then afterwards decreases from 1 to 0. 

P. A remark concerning the result when Rl) and Ro) do not 
lie between K(i,l), M( 1 ,l) and K(o,o), M(o,o) respectively is in order. 
It turns out that in this circumstance optimal strategies may not exist 
although the value is determined in the sense that inf sup = sup inf. 

G. The kernel (1 .1) represents the payoff of a game of timing 
with some kind of partial information as to the time or method of action. 

It is therefore not surprising that the optimal strategy should involve 
partly a density. However, if the game of timing has complete information 
then the optimal strategies behave very much like pure strategies. A game 
of complete information gives rise to a kernel of the following form: 


( 1 - 22 ) 


L(x,y) 


r m(x) 

< L(x,x) 


n(y) 


x < y 
x - y 
x > y 


where C > m* (x) > cf > 0 and -C < n* (x) £ - «f< o. Also, m(l) > n( l) 
while m(o) < n(o) and L(x,x) is bounded but otherwise arbitrary. 

The monotonicity properties of m and n imply the existence of 
a unique a Q with 0 < a Q < l so that m(a Q ) =* n(a Q ). We now establish 
the following proposition: 


THEOREM 1 .2. The game (1.22) has a value 
v « m(a Q ) * n ( a 0 ) and the optimal strategies P and 
G are as follows: If L(a 0 ,a Q ) > v(L(a 0 ,a Q ) < v), 

then P - I (G - I a ) while the player II (player I) 
o o 

has no optimal attainable strategy. Moreover if 
L(a 0 # a 0 ) * v, then the point (a Q ,a 0 ) is a saddle 
point. 


REMARK. We shall treat the kernel (1.22) as a limiting case of 
the kernel ( 1 . i). A different proof of Theorem 1.2 was given by written 
communication by I. Glicksberg. It is felt that the procedure followed 
here is more natural. In addition, we shall drop below the assumptions 
about the values of m and n at o and 1 and indicate the form of 
solutions for the more general game. 



REDUCTION TO INTEGRAL EQUATIONS 


1fc5 


PROOF. Let L*(x,y) be any game of type (1 .1), and consider the 
new games defined by the kernels I^tx.y) - L(x,y) + g L*(x,y) for 
k - 1, 2, It is clear that Lg(x,y) has the properties of the kernel 

of equation (1.1). Explicitly 


IfcU.y) 


m(x) + £ K(x,y) 
^ L(x,x) + ^ 

n(y) + ^ M(x,y) 


x < y 
x - y 
x > y . 


The assumptions on m(x) and n(y) require that for sufficiently large k 
we have an x k , o < x k < 1 , for which m(x k ) + ^ L ^ x k ,x k^ = 
n(x k ) + E M(x k ,x k ), and clearly x k —> a Q . In view of Theorem l .1 (we 
have Case A, B, or C) the form of the unique optimal strategies for the 
game L^x^) is F k * ' G k = > where x k < a Jc < 1 

and only one of the pair £ k , $ k is non-zero. For definiteness we may 

assume that £ k = o for an infinite set of indices, and, replacing our 
sequence by a subsequence we may assume that = o for all k, a k —> a, 
and that, if v k denotes the value of the game L^Xyy), v k —> v. 

Since x k < a k < 1 and x k —> a Q , a Q £ a < 1 ; moreover since 

v k —^ v we may conclude that v is the value of the game L(x,y), that 

is 

(*) inf sup f f L(x,y)dF(x)dG(y) = v = sup inf f |L(x,y)dF(x)dG(y) . 

G F J J F G J J 

for, since LjJXjy) converges uniformly to L(x,y), 

j L(x,y)dF k (x) >v-£, v+£> J^L(x,y)dG^(y) 

for k > k(€.), and (*) follows. 

We may now show that the value v of the game L(x,y) is 

m(a Q ) = n(a Q ). By (1 .2) for Q- k < y < 1 we have 

(x)dx + (m(y) - n(y) )<|) a ^(y) + /° k (y) * 0 

where /^(y) tends uniformly to zero as k —> ». In view of Helly*s 

Selection Theorem we may (again replacing our sequence by a subsequence if 
necessary) assume that there exists a distribution F Q for which 
F k (x) —■> F q (x) for every point x of continuity of F Q . Consequently, 
for y>a + <f, <^> 0 , we have 

/i m ' (TP-^n ' K) 0 ' “ ’ - * k (T) * 


(1.23) 


n'(y) 


/ 


$ 

y % 
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where fc k (y) tends uniformly to zero, and hence 

fj <’ ‘ = i - * 0 W 

at every point y of continuity of F Q . Since ' £) ls 

for t > a + J > a Q , this implies by a classical argument that F Q (y) • 1 

for y ) a + Indeed 

1 - P 0 (y) < M (1 - F 0 (t))dt 

yields, upon iteration (valid since the points of discontinuity of P Q 
form a set of measure zero), 

(1 -F Q (y)) < . 

Since <P > o is arbitrary F Q (y) = i for y > a. For y < a, F k (y) = o 
for k > k(y), hence F Q (y) = 0, and F Q » I a . Moreover, we may now 
assert that a » a Q , for otherwise, since m(y) > n(y) for y > a > a Q , 
we conclude from (1.23) that the functions <J) are bounded, so that F k 
cannot converge to I ft . 

Now for y > a Q , / L(x,y)dF k (x) —> v; consequently 

v * J L(x,y)dF Q (x) « L(a Q ,y) = m(a 0 ) - n(a Q ) . 

Now suppose F is optimal for the game L(x,y). Then we may 
assert that F(x) =0 for x < a Q . For if x Q < a Q , F(x Q ) > 0 , then 
since a k —> a Q , / L(x,y)dG k (y) « m(x) £ m(x Q ) for x £ x Q and k > k Q . 
Moreover, since l^{x,y) converges uniformly to L(x,y) and v k —> v, 
for any fc> 0 we have, for k > k(t), 

J L(x,y)dG k (y) < v + * 

for all x. Now <J*(a Q - x Q ) < m(a Q ) - m(x Q ), and if we set 

£ ? F(x 0 )<f(a 0 “ x b> > 0 we have 

J J L(x,y)dG k (y) < m(a Q ) - tf(a Q - x Q ) - v - <J(a 0 - x Q ) 
for x < x Q . Consequently, for k > k(6), 

JJux,y)dQ k (y)6F(x) ^Ff^Kv - <f(a Q - x Q )) + (1 - F(x Q ))(v + t) 
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< v + fe - P(x 0 )«y(a 0 - x 0 ) 

< v - j P(x Q )tf(a 0 - x Q ) < v 

so that F could not be optimal. 

Since F(x) =0 for x < a Q , we may write F = dl a + F 1 , 

o 

where F 1 is continuous at a Q , F 1 (a Q ) = o F 1 (l) * i - <*-• For y > a Q 
olm(a 0 ) + J J m(x)dF 1 (x) + n(y)(l - dL- F 1 (y) ) > v - m(a Q ) - n(a Q ) 
so that 

J y (m(x) - m(a 0 ))dF 1 (x) + (n(y) - n(a Q ) )(1 - * - F 1 (y) ) >0 . 

Since C(y - a Q ) > m(y) - m(a Q ) > c^(y - a Q ) and F 1 is continuous at a Q 

we have (m(x) - m(a Q ))dF 1 (x) = o(y - a Q ); since 

o 

n(y) - n(a Q ) < - ^(y - a Q ) < 0, we have 


o < <P(y - a Q )(l - oC - F 1 (y)) < - (n(y) - n(a Q ))(l - F,(y)) 

< (mix) - m(a 0 ))dF,(x) - o(y - a Q ) 

so that 1 - oc - F 1 (y) —> 0 as y —> a Q . Thus F 1 (y) = i - oL for 

y > a Q , and P, = (1 - d)I & , F = *1 + (1 - *)I = I • 

o o o o 

A completely analagous argument applies to player II and shows 

that only I & can serve as a solution. The remaining statements of 
o 

Theorem 1.2 now follow readily from these facts. 

REMARK. Let L(x,y) satisfy the conditions of Theorem (1.2) 
except that no requirement Is imposed about the values of m(x) and n(x) 
at 0 and 1 . Suppose moreover that L(0,0) and L(l, 1 ) lie between the 
respective values of m and n at these end points. The optimal strate¬ 
gies are described as follows: (a) (1,1) is a saddle point If and only if 
ra(1) < n(1), (b) (0,0) is a saddle point if and only if m(0) > n(o) and 
(c) for the remaining case the solution is given in Theorem 1.2. 


PART II 


(*) 


We analyze the following class of kernels 


L(x,y) 


K(x,y) 

M(x,y) 


* £ y 

K(x,x) * M(x,x) 

* ^ y 
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satisfying the following conditions. 

(a) In their respective domains both K(x,y) and M(x,y) have 
continuous third partial derivatives. 

(b) K xx (x,y), Ky y (x,y) are strictly negative for x < y and 
M xx , Myy are strictly negative for x > y. In other words K and M are 
each strictly concave in each variable separately on each side of the 
diagonal. The kernel L(x,y) is not however necessarily concave in each 
variable separately throughout the unit square. 

In all that follows we assume (a) anu (b) are satisfied. 

Butterfly Kernel . We examine completely here first a specific 
case of the above kernel (*) which arises frequently in applications. This 
class of kernels was first introduced by Glicksberg anu Gross. 

DEFINITION 2.1 . A kernel of type (*) is said to 
be butterfly if In addition to the requirements (a) and 
(b), we assume 


(c) The function K(x,y) Is strictly increasing in y and 
strictly decreasing In x. Also, M(x,y) is strictly increasing in x 
and decreasing in y. In other words the kernel is monotonic away from the 
diagonal. 

We establish here the following principal theorem. 

THEOREM 2.1. Both players possess unique solu¬ 
tions of the following form F = (ctl 0 ,<|>,/3l ] ) ana 
G - (ri 0 ,v, c fi 1 ) where 0 and Y are absolutely con¬ 
tinuous over the full interval ana are obtained as the 
unique solutions to a pair of integral equations. 


( 2 . 1 ) 

( 2 . 2 ) 

where 


p i “T 


di P, ♦ fiV 2 38 


+ rfq? 


n 

V - U Y 


JJY 


■fi 


(x,y) 


o lCy(y,y)-My(y,y) 


<|>(x)dx + 


si*^ 

S'. 


(x,y) 


Ky(y»y?-Myfy,y> 
“ K X x( x,y ) 


$(x)dx 


li x (x,x)-K x (x,x) + J x M x (x,x)-K x (x,x) ^ y ^ dy 

*1 


(°> 7 ) ,y) 

TTyTyP p 2 “ (^4})(y,y)’ 


-M^x.o) -Kxx (x 

(^■-^'(x.x)' ^2 - (M^Hx.x) • 


The solution of these Integral equations can be obtained by the 
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use of Neumann Series. For clarity of understanding, we shall divide the 
proof into a series of lemmas. 

REMARK. The operators T and U constitute strictly positive 
operators which transform positive continuous functions into continuous 
strictly positive functions. The properties enunciated in Part I for such 
operators are valid for T and U. Finally, the operator T ab etc. shall 
denote the same operator T except that the Integration is extended over 
the interval a < x < b. 

LEMMA 2.1. The radius of the spectrum 
A(T Ql ) [>i(U o1 )] of the operator T [U] is less 
than 1. 

PROOF. If we assume the contrary, then A(T Ql ) > 1 . As we let 
a —•> 1 , then A(T al ) —> 0 . By Property II of positive operators there 
exists an a for which A(T ftl ) = 1 . Property I guarantees a non-negative 
eigenfunction f(x) such that T &1 f - f. Upon integration of Tf = f, 
we get 

j Ky(x,y)f(x)ux + M^(x,y)f(x)ax = c 

for a < y < 1. Sotting y = a, as M^(x,a) <0, we have c < 0. On the 
other hand if we put y - 1, then as (x,i) > 0, we secure that c > 0. 
This contradiction establishes the assertion of this lemma. A similar 
argument applies to the operator U- 

Lemma 2.1 enables us to invert (2.1) and (2.2) for any non-nega¬ 
tive ct, fi, y, ana we produce positive continuous functions. Explicitly, 
let (I - T)‘ 1 p 1 - 1 - 1,8 ana (I - U)' , q 1 = $ 1 1 - 1 , 2 . Put 

0 = o*.<t> 1 + fi$ 2 and Y ~ ' 

LEMMA 2.2. There exists optimal strategies of the 
following form F = (<AI Q ,<i>(x) ,/3I 1 ) and G = (yi Q ,y,^I 1 ). 

PROOF. We suppose that all the quantities have been defined as 
above. Integration once of (2.1) gives that 

( 2 . 3 ) c = AKyO.y) + ySKy-d ,y) + KyU.yWxJcx + J*’ My(x,y)i|>(x)dx • 

We choose and £ so that /<t>= s ot/$ 1 + £ / 4> 2 * 1 - c*. - There 
exists in fact an entire Interval of values for which this Is fulfilled. 
Supposing first <t *» 0 and then letting y - 0, we obtain 
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c - /»My(1,0) + J'o My(x,0)$(x)dx < 0 . 

In a similar manner, if we choose p - o and look at y « 1, we secure 
that c > 0. Continuity thus produces a choice of cL > o and fi > o so 
that c * o. Analogously, we find the existence of positive constants t 
and 4 so that 

(2.4) o * VMgfXjO) +<£K x (x,1) + f* M^x^WyJdy + j* x My(x,y)Y(y)dy 
An integration once more of ( 2 . 5 ) and (2.4) yields that 

J q L(x,y)dF(x) * b and J L(x,y)dG(y) * d 


where 


F = (dLl 0 ,QU) and G = (&I 0 ,Y(x) ,<fl 1 ) . 

Multiplying the first by dG and the second by dF and integrating shows 
that b - d - v. It remains only to establish the uniqueness. 

LEMMA 2.3* If F is optimal for player I, then 
on the interior of the unit interval F is continuous. 


PROOF, 
optimal, we have 


Let y Q be any point where 0 < y Q < 1 . Since F is 
/ L(x,y)dF = v for all y. Thus 



L(x,y)-L(x,y 0 ) 


dF 


0 for y ^ y Q . 


As the right-hand derivative exists everywhere and is bounded, then with 
the aid of bounded convergence, we get / L^ + (x,y 0 )dF = 0 . Similarly, we 
obtain / Ly_(x,y 0 )dF - 0 . Since Ly + (x,y 0 ) - Ly_(x,y Q ) except for 
x - y Q , we have 

0 - f (Ly + -Ly.)(x,y 0 )dF(x) = [K y (y 0 ,y 0 ) - My(y 0 ,y 0 ) ] r- p . 

Thus <r v F « 0 and the proof is complete. 
y o 

LEMMA 2.4. If F is optimal, then F is abso¬ 
lutely continuous and F' - f is continuous for the 
points where 0 < x < 1 . 

PROOF. Since F is optimal, we have 
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( 2 . 5 ) V a J L(x,y)dF(x) - «i o K(0,y) + ^ Q M(l,y) 

+ Jl K(x,y)dP 0 (x) + M(x,y)dP 0 (x) 

where F Q (x) represents the continuous part of F(x) concentrated on the 
Interval of 0 to 1 . An integration by parts of the last two Integrals 
gives 

(2.6) J J K(x,y)dP 0 (x) + J y M(x,y)dF 0 (x) = - J J K x (x,y)P 0 (x)dx 

- M x (x,y)P 0 (x)dy + M(i ,y)P 0 (i) . 


This formula is valid by virtue of Lemma 2.3 which established the con¬ 
tinuity of F Q (x). Differentiating ( 2 . 5 ) after ( 2 . 6 ) has been substituted 
into ( 2 . 5 ) yields 

( 2 . 7 ) 0 = «t oKy ( 0 ,y) ♦ lfi 0 + F Q ( 1))My( 1 >y) - fl Vo* - /; Vo to 

- [K^y^) - M^y^y)] P Q (y) . 


Since Kx ~ Mx > <0 0 we 3ee (2-7) by assumption (a) that F Q (y) is 

absolutely continuous. Upon differentiating once more which is valid by 
assumption (a), we obtain that F 0 (y) = f(y) is continuous. 


LEMMA 2 . 5 . The optimal strategy for player I is 
unique. 


PROOF. Lemma 3 shows that any optimal strategy for player I has 
the form F(ot,f (x) ,fi) with f(x) continuous for 0 < x < 1. Differ¬ 
entiating / L(x,y)dP = v twice establishes that f satisfies equation (1) 
i.e.. 


cLV } + y3P 2 


f - Tf . 


Clearly f = ot^ 1 + >S<|> 2 . It remains to show that there exists a unique pair 
of positive quantities d., • satisfying 


( 2 . 8 ) 

and 


1 - cL - j3 


*/♦ 1 + fi 

(2.9) ot-KytO.y) + < 5M y (l,y) + j** Ky(x,y)f(x)dx + J'y My(x,y)f(x)dx - 0 
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with f(x) « +/S$g. If the solution to these two equations is one 

dimensional, then there is a solution of the form o, ft « 0. However, 
this is impossible for then by taking y *= 1, we obtain that the relation 
(2.9) is strictly positive. 

PROOF OF THEOREM 2.1 . This is the content of Lemma 2.2 and 
Lemma 2.5 with a dual proof to Lemma 2.5 establishing the uniqueness of the 
optimal G strategy. 

We close this section witli some additional remarks. 

If L(x,y) Is a butterfly kernel and L(x,y) = L(y,x), then the 
unique optimal strategy for each player coincide. This is due to the fact 
that the Integral equations which produce the solution are the same. 

We now present a few examples of butterfly kernels, specifically, 

(a) L(x,y) « |x - y| - A(x - y) 2 where 0 < A £ | 

(b) L(x,y) « max(m(x)n(y), n(x)iu(y)) 

with m(x), n(x) > k > 0, m*(x) < -k < 0, n' (x) > k > 0, and m*'(x), 
n' *(x) < -k < 0 . 

Kernels concave on each slue of the diagonal . In this section, 
we drop assumption (c) and suppose only that (Ky - My)(y,y) > 0 and 
(M x - K x )(x,x) > 0. This includes the case wherein the kernel has 
butterfly shape only in the neighborhood of the diagonal. 

THEOREM 2.2. Unc.er the condition stated above all 
the optimal strategics tiave the following form: There 
exists a unique interval [a,b] such that any maxi¬ 
mizing strategy F = (ctl a ,<|> at) (x) ,)3l b ) and any mini¬ 
mizing G» (Jf I Q ,y ab (y) ,<fl 1 ) where cl > 0 when 
0 < a < 1 and fi > 0 when 0 < b < 1 . Generally, <±, 

A ’ X, > 0 and (J) ab , V ab are obtained as the Neumann 
Series or eigenfunctions to associated integral equa¬ 
tions. There exists at most a one dimensional set of 
solutions for each player. 

The proof of this theorem is subdivided into a series of lemmas. 
Although an analagous method to that used In the study of butterfly kernels 
can be employed to treat this case, we follow a different procedure which 
is also applicable to the preceding section. Both approaches have their 
individual merits and are useful for different particular examples. 

LEMMA 2.6. There exists a unique interval [a,b] 
which is the spectrum of any optimal strategy for the 
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maximizing player. If this interval is non-degenerate, 
it is, with the possible addition of 0 and l, the 
spectrum of any optimal strategy for the minimizing 
player. If a = b, then the spectrum of any optimal 
strategy for the minimizing player is contained in 
{o,a,l). 

PROOF. We shall let F and G represent optimal strategies for 
the maximizing and minimizing players, respectively. If (c,d) is any 
open interval of F measure zero with 0 < c < d < 1, it is easily seen 
that / L(x,y)dF(x), which is > v, is strictly concave for e < y < d, 
hence > v In this interval. Consequently the spectrum of any optimal G 
cannot meet this interval, and the spectrum of any optimal G is contained 
in the spectrum of any optimal F, with the possible exception of the end 
points 0 and 1. 

Now suppose c and d are in the spectrum of F, c < d, and 

(c,d) is of F measure zero. Then (c,a) is of G measure zero for any 

optimal G, so that / L(x,y)dG(y) is strictly concave for c < x < d. 
Since this integral is a continuous function of x and must assume the 
value v at c and d we have / L(x,y)dG(y) > v for c < x < d, which 
contradicts the optimality of G- Hence the spectrum of any optimal F is 
some closed Interval [a,b]. » 

Suppose that for some optimal F this interval is non-degenerate, 
i.e., a < b. Then [a,b] is contained in the spectrum of any optimal G 
since / L(x,y)dG(y) = v for a < x < b so that no open subinterval is 

of G measure zero. Combined with the fact that the spectrum of any G 

is contained (disregarding 0 and i) In the spectrum of any F, this 
implies that the spectrum of any optimal F' coincides with (again dis¬ 
regard ir\g o and 1) that of G, so that [a,b] is the spectrum of all 
optimal F, ana similarly of all optimal G (again disregarding o and 
1). 

If on the other hand [a,b] is degenerate for all optimal F, 
it Is still unique. For suppose I a and I a , are optimal, a ^ a*. Then 
since the spectrum of an optimal G is contained in (0,a,1) end 
(o,a',i), the spectrum of any optimal G is contained in (0,1) so that 
/ L(x,y)dG(y) is strictly concave for o < x < 1, < v and yet equal to v 
at a and a', which is clearly absurd. 

LEMMA 2-7- The maximizing optimal strategies have 

the form F * ^a'^ab^'^b^ with ^ 0 when 
o < a < 1 , > o when o < b < 1 , and «l > o, /S > o 

otherwise. 
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PROOF. The identical arguments of Lemmas 2.3 and 2.4 apply here 
and show with the aid of Lemma 2.6 for x Interior to the closed interval 
[a,b] that F(x) is absolutely continuous and F'(x) « f(x) is con¬ 
tinuous over the interval [a,b]. We now verify that if 0 < a < 1, then 
F possesses an additional point spectrum at a. To this end, if we assume 
the contrary, then the derivative of h(y) - / L(x,y)dF(x) exists and is 
zero at a. Since h(y) is strictly concave for 0 < y < a, this implies 
the fact that / L(x,y)dF(x) < v for 0 < y < a which is contrary to the 
optimal character of F. A similar argument applies to the end point b 
if it is interior to the unit interval. 

LEMMA 2.8. The minimizing strategy G has the 
form g- (yi 0 ,y ab ( y ) ^ I 1 ) with r, > o. 

PROOF. As in the previous, lemma it is easy to deduce that G is 
absolutely continuous over the interior of the Interval [a,b]. In view of 
Lemma 2 .6 it remains only to show that if 0 < a < 1 , then G is con¬ 
tinuous at a. As in Lemma 2 . 3 , it follows that / L x+ (a,y)dG(y) = 0 . On 
the other hand, we have / L(a,y)dG(y) - v and / L(x,y)dG £ v for x < a. 
Consequently, / dG(y) > 0 for x < a. Proceeding to a 

limit gives that / L x _(a,y)dG > 0 . Therefore, 0 > / (L x+ - L x _) 

(a,y)dG(y) - (M x - K x ) (a,a)<r a G. Since M^^ - > 0 and <f & G > 0 , we 

deduce <r a G = 0. An analogous argument applies at the point b if 
0 < b < 1. Indeed, / L x _(b,y)dG(y) = 0 and / L(b,y)dG(y) = v while 
/ L(x,y)dG(y) < v for x > b. Whence / L x+ (b,y) < 0 . Therefore, 

O > J IL x+ (b,y) - L x _(b,y)] dG(y) = (M* - K^^CG) ■ 

Again, this gives that ^(G) ** 0 . This completes the proof of the lemma. 

Upon two differentiations of J ] Q L(x,y)dF(x) = J ] Q L(.x,y)dG(y) - v 
for a < x, y < b, we obtain for <t) * <J> ab and Y - that 

(2.8) 0 « dKy y (a,y) + ^M yy (b,y) + J J Ky y (x,y)<|>(x)dx + 

J" y + (Ky - My) (y,y)<l>(y) . 

(2-9) 0 - XM^tx.O) + tfK^x.l) + Jl ^(x.ymyjdy + 

f\ K^x.yWyJdy + (M* - JjHx.xlYlx) . 

Expressing these Integral equations differently, we get 
* Pl T ab « 


( 2 . 10 ) 
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( 2 . 11 ) 


*q, ♦ rfq 2 = V - U ab r 


where 


T ab* " /a - (K^nlly) * (x)dx + fy ‘ * (x)dx ’ 


-K-^(a,y) 
p i ~ (Ky-MyJly.y) 


-JUhil 


and 


^2 Ky-My(y,y) 

/ _ lt. v (x,y) P h K^U.y) 

a " m x (x,x)-k x (x|x) V( y )d y + J x" m^x.xj-k^x.x) v(y)dy 


-M^U.O) -K xx (x, 1) 

q l = (M x -K x )(x,x) ' q 2 = TM^^TTxTxT ’ 

The two integral equations (2.10) and (2.11) are to be used to determine 
<t>(x) and Y(x). The fact that and q i are positive implies that 

$ > T at> <J) and Y > U ab Y- Using again the general theory of positive 
operators [ 3 ] yields that A(T ab ) < 1 and /*(U ab ) < 1 . If either a or 
b are interior to the interval [ 0 , 1 ], then A(T ab ) <1. In fact. 

Lemma 2.7 guarantees that (2.10) Is satisfied with at least <L or /B 
non zero and one concludes from this (since > cf > 0) that T ab <|> < A<|> 
with A < 1 • Thus A(T ab ) < A < 1 . Concerning >*-(U ab ), we have that both 
cases where M(U ab ) = 1 and /i(U ab ) < 1 may occur. 

Let 0 < a < b < 1 . 


CASE 1 . If /4U at) ) = 1 , then the optimal strate¬ 
gies have the form F = (dl a ,(|) at) (x) ,^I b ) and 
G = (V a fc(y)) with cl > 0 and > 0. 

PROOF. Lemmas 2.6 to 2.8 have established that the optimal solu¬ 
tions have the form F = ,/3I b ) and G = (fl^Y^x) ,<**1,). If 

either f or <f were not zero, then equation ( 2 . 11 ) would imply that 
XU ab ) < 1 contradicting the hypothesis. 

Let 0 < a < b < 1 . 


CASE 2 . If /*( U ab ) < 1 , then the form of the 
optimal strategies is as follows: F « (*l a ,<> ab (x},/0I b ) 
and G « (Xl 0 ,^ b (y) ,£1,) with ot, p > 0 and at least 
or positive. 


PROOF. The demonstration is similar. 
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Let o < a < b » i . 

CASE 5 • If A(U ab ) - 1, then F - (*I a , 

and G * (Y ab (x)) with * > o and > o and at least 

K or <P positive. 

The proof of this is similar to the preceding. An analogous set 
of results presents itself when o « a < b < 1 and o « a < b * i . 

We finally remark that when Y > o in any of the above strategies, then 
this imposes a condition on the yield / L(x,y)dF(x)s namely 
/ L(x,0)dF(x) * v = / L(x,a)dF(x). A similar requirement results when 
$ > 0, i.e., / L(x,l)dF(x) * / L(x,b)dF(x) * v. These conditions 

determine a and b uniquely. 

We now discuss the question of uniqueness. Whenever at least a 
or b is interior to the unit Interval and there exists an optimal mini¬ 
mizing strategy using both end points o and 1 , then we show that the 
maximizing strategy is unique. The proof of Theorem 2.2 has shown that 
any optimal strategy for player I has the form F = (dl a ,4> ab (x) ,j8I b ) with 
4> ab (x) = <M>, (x) + £0 2 (x) where (I - T^) - ^ = 4*^ and 1=1,2,. 

We must verify that the choice of d. and fi are unique. For any values 
of dL and which supply optimal strategies it follows that 

0 = 4Ky(a,y) + /flMyOa.y) + Ky(x,y)<|) ab (x)dx + J'y My(x,y)i|> ab (x)dx 
for a < y < b. 

This has the form ciR(y) + /5S(y) = 0. Explicitly 
R(y) * Ky(a,y) + J a LyCx^)^ (x)dx and S(y) - M^(b,y) + / a Ly(x,y)<|> 2 (x)dx. 
From the properties of the integral operators it follows that R(y) s c 1 
and S(y) s c 2 . If R(y) or S(y) is not zero, we get a one dimensional 
set of solutions for <*. and /3. The normalization l - «l - = 

dl / + fl J $2 produces a unique choice of (d.,/9) in this one dimensional 

set. We may hence assume that R(y) = S(y) = 0 for a £ y < b. The 
assumption on the minimizing strategy implies for any optimal F that 
/ L(x,0)dF(x) “ v = / L(x,y)dF(x) for a £ y £ b. Expanding this equality, 
we get otk 1 + ySk 2 - o with another similar relation dl 1 + /31 2 « o, re¬ 
sulting from consideration of the point 1. It is to be emphasized that the 
constants k 1 and k 2 do not depend upon dL or /3. These equations 
cannot possess a two dimensional set of solutions for then there would 
exist an optimal F strategy with no jump at either a or b which con¬ 
tradicts Lemma 2.7- The normalization again selects thus a unique pair. 

If ;u(U ab ) « 1 , the uniqueness of the optimal strategy for the 
minimizing player follows from the fact that any solution of the form 
WI 0 .Y ab (y)) ,rfl,) with say X > a implies MU ab ) < i and the eigen- 
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function is unique (Property I of strictly positive operators). We have 
been able to verify in every particular example the uniqueness. However, 
the uniqueness question in general remains open. The fact that we get at 
most a one dimensional set of solutions follows since they all satisfy the 
same integral equation. In fact, /3 range only over a one dimensional 
set since the additional normalization restricts one of the variables. 

An example . We illustrate the theory of the preceding section 
by the following example. Let 

{ K(x,y) « y - x - A(x - y) 2 y > x 

A > 0 • 

M(x,y) = x - y - A(x - y) 2 x > y 


It Is easily verified that K xx = = -2A and 

Ky = 1 + 2A( x - y) , My - -1 + 2A(x - y) . Furthermore, it is easy to 
show that this kernel is Invariant under the transformation x —> l - x 
and y —> 1 - y. It therefore follows that there exists optimal strate¬ 
gies F(x) and G(y) which are unchanged'under the mapping x —■> 1 - x 
and y —> 1 - y respectively. Consequently, we search for a symmetric 
Interval about j to play the role of [a,b]. The solution to the 
Integral equation 

1 + c 

A = <P(y) - J 2 2 ^ ♦(x)dx 

2 ' 2 


implies that <|)(x) = yjfy • 

If we consider the equation oLp 1 + £p 2 = 5? - T ab^ with P “ 

we get = A and ct = 1 . The condition / L(x,o)dF = / L(x,a)dF 

^ 2 — A 

implies after a simple calculation that either c - 1 or c = -r-^. This 

gives that a = 1 - ^ and b « ^ when c = — j- and a = 0, b = 1 when 

c - 1 . For o < A < 1 the operator T$ = / M has A(T) < 1 while for 

1 < A < 2, we have A(T) > 1 thus to generate a positive operator of 

spectral radius less than 1 it suffices to take the Interval (1 - 

for 1 < A < 2. If we compute * for the two cases we get <*. = when 

o < A < 1 and when A is between 1 and 2. We have therefore 

found the form of the strategies to be for 0 < A < 1 

I 1> 

G- i 0 . y 01 (y) ' 1 i^ V 



and for \ < A < 2 
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1 * i 1 (x) ¥ I i ) 

1 “ J 1 ~ A' A A 

(tV v , , (y). ^i,) • 

For A > 2 one verifies directly that the optimal strategies are 

F - (I,) and G - (1 I Q , \ I,) 

2 

and the value is equal to ^ - A(^) 2 . In all these cases of this example 
it can easily be shown that these optimal strategies are unique. 
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ON A CLASS OF GAMES* 
Samuel Karlin 


The purpose of this note is to describe qualitatively the nature 
of optimal strategies for a payoff kernel K(x,y) defined on the unit 
square satisfying y (x,y) > o with n partial derivatives taken with 

respect to y. We present a complete analysis for n < k. However, the 
method employed seems to extend easily and should enable one, by enumerating 
cases, to analyze the situation for general n. Specifically, we show that 
for n = 3 and n » 4 the maximizing player has optimal strategies in¬ 
volving respectively at most 3 points and at most U points of increase. 

For general n, it can be shown that the maximizing player has optimal 
strategies using at most n points. For the minimizing player the state¬ 
ment of the nature of an optimal strategy is more precise. There always 
exist for the general case optimal solutions using at most § points, with 
the understanding that the end points 0 or 1 when used are each counted 
only half. For example when n is odd, then ^ is a half integer and 
hence must use a single end point if a full optimal strategy exists em¬ 
ploying points. This counting procedure applies only to the minimizing 
strategies. 


i 1. OPTIMAL STRATEGIES FOR PLAYER II 

We assume throughout this section that Ky ^(x,y) >0 In the 

unit square with n partial derivatives taken with respect to y and that 
K possesses continuous n th partial derivatives. 

LEMMA 1. If Ky y(x,y) > 0, then there exists 
an optimal strategy for player II with at most ^ 
points of increase. 

REMARK 1 . It is sufficient to prove Lemma 1 when 
Ky...y( x ,y) > > °* Indeed, if we perturb K by 

K^(x,y) = K(x,y) + i L(x,y) where L^.. <y (x,y) > > 0, 


*The preparation of this paper was supported by The RAND Corporation. 
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then K^x^) converges uniformly to K(x,y) and 
k 2 _(x,y) > ~ 6 > 0 for each n. The function 
L(x,y) can be chosen to be an n^* 1 degree polynomial 
in x and y with the coefficient of y n a- strictly 
positive polynomial for x ranging in the unit inter¬ 
val. Each kernel yP possesses an optimal solution 
G n for player II of at most ~ points in the spectrum 
We can select a limit distribution G^ which also in- 
volves at most ^ points of increase. Similarly, let 
P denote any limit distribution of optimal strategies 
F n of the games Yp(x,y) • It follows easily that G Q 
and P are optimal strategies for players II and I 
respectively for the game with kernel K(x,y). 


PROOF OF LEMMA 1 . In view of Remark 1 we may assume that 
Ky y (x,y) > 0 for x,y traversing the unit square. Let F Q (x) denote 
an optimal strategy for player I, then the hypothesis and bounded conver¬ 
gence easily yields that h(y) «= K(x,y)dF Q (x) has h^(y) > o. This 
implies that h(y) can achieve a value at most n times since otherwise 
there exists a y Q with h n (y Q ) = 0. Consequently, the minimum m of 
h(y) can only be achieved at most ^ times, end points being counted half 
as described in the introduction; for otherwise m + e with e sufficient¬ 
ly small would be taken on at least n + i times. Since an optimal strate¬ 
gy for the minimizing player can only concentrate at these points, the 
conclusion of the lemma is now evident. 


f 2. OPTIMAL STRATEGIES FOR PLAYER I WITH n - 1 AND 2 

The case n » l yields a saddle point. In fact if x Q denotes 

a point where K(x ,0) « max K(x,0), then it is easily verified that 

x 

x - x Q and y - o is a saddle point. 

LEMMA 2. Let X be compact and Y an n dimen¬ 
sional simplex. If M(x,y) is a continuous payoff 
kernel defined on X x Y which for each x is a con¬ 
vex function in y, then there exists an optimal 
strategy for player I involving at most n + 1 points 
of increase. 


This lemma comprises the essential result of [1]. For a more 
direct and illuminating proof see a forthcoming paper by the author on the 
general theory of infinite games. 

The content of Lemma 2 contains the case of n - 2 being analyzed 
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in this paper. Player II has a pure optimal strategy while player I pos¬ 
sesses an optimal solution using at most 2 points in its spectrum. 

$ 3• OPTIMAL STRATEGIES FOR PLAYER I WITH n - 3 

Throughout this section we assume that Kyyy(.x,y) > 0 and we 
establish the following theorem. 

THEOREM 1. If K possesses continuous third 
partial derivatives and Kyyy(x,y) > o for 
0 1 x >y < 1 » then player I has an optimal strategy 
F with at most 3 points of increase. 


The proof of this theorem will consist in analyzing the various 
possibilities. It Is no loss of genera^ty to suppose that Kyyy(x,y) > 0. 
An argument analogous to that used in remark 1 establishes this fact. 
Moreover, any optimal minimizing strategy Involves at most 3/2 points. The 
various possible minimizing strategies are therefore of the following forms, 
where I y denotes a pure distribution with full weight at y: (a) dLl Q + 

(1-*)I with 0 < y < 1, (b) oil + (1-*)I,, (c) I with 

•>o J o 

0 < y n < 1 > (d) I n and (e) I.. The strategies listed above present 

o u I 1 i 

an enumeration of all the possible ways of obtaining 1, or 1 ^ 
points, with the exception of one. It remains only to show why an optimal 
strategy of the form *1^ + (1-*)^ with 0 < y Q < 1 cannot occur. 

(A) In fact, if F(x) is optimal for player I, then 
H(y) - /q K(x,y)dF(x) has the properties that h( 1) « h(y Q ) = v, h(y) > v, 
and h*''(y) > 0. This implies that h Is convex in the neighborhood of 
y Q where h attains a minimum and further, since h(l) « v, that h is 
concave at y 1 > y Q . Thus h ,, (y Q ) > o and h 1 '^) < 0. But since 
h* 1 '(y) y o, It follows that h**(y) is increasing which Is incompatible 
with the preceding remark. 

In general, once the yield h(y) = K(x,y)dF(x) is convex then 
it cannot turn back and become concave. 

To establish the assertion of Theorem 1, we shall show for each 
of the possible forms of an optimal solution for player II that player I 


possesses an optimal strategy of the desired type. 


Case (a). Since G 


"o + (, - rt)I y r 


is optimal for player II, 


any value x occurring with positive probability in an optimal strategy F 
must imply that f ] Q K(x,y)dG Q (y) - v. Let X be the set of all x for 
which K(x,y)dG Q (y) - v. Evidently, the set X Is compact. We now 


introduce the following auxiliary game defined for x in X and z 
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ranging over a 2 dimensional simplex Z spanned by z 1 , z 2> and Zy 
For x in X, set M(x,Zj) - v 1 - v, where v 1 is the value at 1 of 
the tangent line to K(x,y) at y Q , M(x,z 2 ) - v 2 - v, where v 2 is the 
value at o of the tangent line to K(x,y) at y Q , and 
M(x,z^) - K(x,0) - v. Extend M(x,z) linearly over Z for each x. 

It is easy to verify that the hypothesis of Lemma 2 are satisfied. Also 
if F is optimal for the game K(x,y), then / x M(x,z)dF(x) = o. There¬ 


for each x. 
satisfied. Also 


There¬ 


for which 


<*J 0 + (1 -cc)i 1 . 


fore, there exists an optimal F*( * A 1 I X + A 2 I X + A^I X ) for which 

/ x M(x,z)dF*(x) > value > 0. We consider h(y) = K(x,y)dF*(x). The 
interpretation of the game M(x,z) shows that the tangent to h(y) at y Q 
lies above v at 0 and 1. Thus h(y Q ) > v. Also, h(0) > v. However, 
since x 1 , x 2 , and x^ belong to X, we obtain tliat v £ /£ h(y)dG Q (y) = 
/q dF*(x) /q K(x,y)dG 0 (y) * v. This yields that h(o) « h(y Q ) = v and 
hence the slope h'(y 0 ) = 0. The argument of paragraph (A) shows that 
h(y) is convex at y Q and h(y) > v throughout. 

Case (b). Let X consist of all x for which 
v - K(x,y)dG Q (y) where G Q (y) is optimal and of the form 
aI q + (1-&)Ij. Evidently, X is compact. Let M(x,z) be defined over 
the set X and the two dimensional simplex z spanned by z 1 , z 2 , and 
Zj defined as follows. Put M(x,z.,) = K(x,o) - v, M(x,z 2 ) = K(x,l) - v 
and M(x,z 5 ) = - Ky(x,l) with M(x,z) extended linearly over z. If 
F q (x) is any optimal strategy for player I of the game corresponding to 
the payoff kernel K(x,y), then / x M(x,z)dF(x) >0. In view of Lemma 2 
we can find an optimal strategy F*(x) using at most 3 points x in X. 

If h(y) = J ] Q K(x,y)dF*(x), then h(o) > v, h(l) > v and h'(l) <0. 

Since G Q (y) concentrates only at 0 and 1 and 

/q dG Q (y) /q K(x,y)dF*(x) = v we conclude that h(0) * h(1) - v. Further¬ 
more h*(y) is negative at 1 and h*''(y) > o requires therefore that 
h(y) is greater than v throughout the unit interval. 

Case (c). In this case an optimal minimizing strategy exists 


I Q K(x,y)dF*(x), then h(o) > v, h(l) > v and h'(l) < o. 


concentrating at the point y Q . Let X comprise all x where 

K(x,y 0 ) - v. Again, we introduce the auxiliary game M(x,z) with x 
In X and z in the two dimensional simplex. Put MCx^) * + Ky(x,y Q ), 
M(x,z 2 ) « - Ky(x,y Q ), and M(x,z^) - K(x,0) - v with the usual linear 
extension. An analogous reasoning produces an optimal strategy 
F*( oil + bI + YT ) with / Y M(x,z)dF*(x) > 0. The function 

Xj ’ X 2 Xj A — 

h(y) - /q K(x,y)dF*(x) has the properties that h(y Q ) = v, h , (y Q ) - o 
and h(0) > v. The argument in (A) and h(0) ^ v show that h is convex 

at y Q and since h(o) > v we easily find that h(y) > v for 0 < y < 1 . 

Case (d). The form of G 0 is I Q . We select for X all x 

where K(x,o) - v, and for some optimal F 0 we set m(y) - / K(x,y)dF Q (x) 
Evidently ra'^ty) > o, so that m* 1 is strictly increasing, and we may 
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divide the analysis into the following exhaustive subcases: 

(d 1 ) m* • (y) < 0 ° < y < 1 , 

(d 2 ) m* • (y) > 0 ° < y < 1 , 

(d 3 ) m*' ( 0 ) < 0 < m*' ( 1 ) . 

(d^. We define an auxiliary game M(x,z) as follows: 

M(x,zp = - Kyy(x,l), M(x,z 2 ) = K(x,l) - v. In this case Z is one 
dimensional, and by Lemma 2 we can find an optimal strategy F* using 
two values x in X for the auxiliary game. Now h(y) = J ] Q K(x,y)dP*(x) 
satisfies h• • (1) < 0 , h(o) = v and h(i) > v. Since h* * is increasing, 
h is concave. Since h(y) is no less than v at both ends of the unit 
interval, h(y) > v for all y, and F* is optimal for the original game. 

(d 2 ). Since m(y) > v and m(o) = v, we must have m'(0) > 0. 
Consequently, defining the auxiliary game by M(x,z 1 ) = Kyy(x,0), 

M(x,z 2 ) = Ky(x,0), Z is again one dimensional and / M(x,z)dF Q (x) > 0. 

By Lemma 2 we have an optimal F* for the auxiliary game using two points 
in X, and for h(y) = / K(x,y)dF*(x) we have h**(0) > 0, h*(o) > 0 

and h(0) = v. Since h'• is increasing, h is convex; combined with the 

fact that h(o) = v, h*(o) > 0 , this yields h(y) > v, or the optimality 
of F* in the original game. 

(d^)• Consider the graph of m. Since m 11 is strictly in¬ 
creasing we have a unique point of inflection y Q , 0 < y Q < 1 , m ,, (y 0 ) = 0. 
For some y 1 , y Q < y! < 1, the tangent line to the curve at y 1 will have 

its value at 0 as well as its value at l > v. For If m*(y 0 ) > 0, this 

will be true for y 1 = y Q since the tangent at y Q lies above the concave 

portion of the curve (where y £ y Q ), and thus the height of the tangent 

line at 0 will be at least v = m(o); since the slope of the tangent Is 
non-negative this is also true at 1 . On the other hand if m*(y 0 ) < 0, 
then either we have a point y 1 , y Q ( y 1 < 1 , where m , (y 1 ) = 0 (and 
hence where the entire tangent line is above the height v since 

mfyp ^ v) or m*(y) < 0 for y Q < y ( 1 ; since m(l) > v, the tangent 

line at 1 will do In this case. 

We now define an auxiliary game over X and a two dimensional 
simplex Z via the usual linear extension ana M(x,zp = Kyy(x,yp, 

M(x,z 2 ) = v 1 - v, M(x,zp - v 2 - v, where v 1 and v 2 are, for fixed x, 
the heights at 0 and 1, of the tangent line to the curve K(x,y) at 
y 1 . We have chosen y 1 so that / M(x,y)dF Q (x) ^ 0 , and thus by Lemma 2 

we have an F* = + /5I„ + for which / M(x,z)dF*(x) > 0 . But 

X 1 x 2 “ 
for h(y) = / K(x,y)dF*(x) we have the heights at 0 and 1 of the 

tangent line to the curve h(y) at y 1 > v; since h* * 1 > 0 , the convex 
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portion of the curve occurs over an interval [a,1] which includes y 1 
since h'^y,) > o. The convex portion clearly lies above the tangent line 
at y 1 , and since the concave portion of the curve, which occurs over the 
interval [0,a], has both endpoints above the height v, h(y) > v for 
all y, and F* is optimal in the original game. 

Case (e). This can be analyzed similarly to case (d). Since 
these five cases exhaust all the possibilities the proof of Theorem 1 ip 
now complete. 

^ If. OPTIMAL STRATEGIES FOR PLAYER I WITH n = If 

Throughout this section we assume that Ky yy y(x,y) > 0. The 
following result is demonstrated. 

THEOREM 2. If K possesses continuous fourth 
partial derivatives and Ky yyy (x,y) > o for o < x, 
y £ 1, then player I has an optimal strategy with at 
most 4 points of increase. 

The method of proof of this theorem Is analogous to that employed 
in Theorem 1. Again, without restricting generality we may assume that 
Kyyyy(x,y) > 0. Furthermore an optimal strategy for player II involves at 
most 2 points. The various possible minimizing strategies are there¬ 
fore of the form (a) <*I + (1-*)I , with o < y < y < i, 

y o y 1 o i 

(b) dJ Q + (1-4)1 with 0 < y Q < 1 , (c) + (1-o<)I y with 

o < y 0 < 1 , (d) *I Q + (1-*)^ , (e) Iy with 0 <y o <l, (f) I o , 

and (g) 1^ . We have omitted one additional possible strategy with total 

weight 2; namely al Q + 0I y + (i-cU/S)^, where 0 < y Q < 1. This form 

for an optimal strategy is not possible. 

(B) Indeed, let us suppose that player II has an optimal strategy 
of the above form. Let F_(x) be optimal for player I, then 

i o 

m(y) ■ / 0 K(x,y)dF Q (x) has the following properties: m(o) - v, m(l) « v, 
m(y ) ■ v, m*(y 0 ) - o and m(y) > v for o < y ^ l . It follows then that 
m is convex at y Q while concave somewhere between o and y Q and some¬ 
where between y Q and 1. This contradicts the fact that m''(y) is 
convex which is required by m*''*(y) > 0. 

We shall frequently use this general fact that the yield m(y) 
of any strategy F (i.e., ra(y) * f ] Q K(x,y)dF(x)) cannot be concave in two 
portions and convex in between. 

The proof of Theorem 2 will consist in verifying for each of the 
possible forms of the optimal strategies for player II that an optimal 
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strategy for player I of the desired type exists. 

Case (a). Let the minimizing player have an optimal solution of 
the form G 0 - *I y + (l-*)I y , where 0 < y Q < y 1 < 1 . Let the set X 

consist of all x for which J K(x,y)dG Q (y) * v. We construct now the 
following auxiliary game M(x,z) defined for x in X and z in Z 

where Z is a 3 dimensional simplex spanned by the points z } , z 2 , z^ and 

z^. For x in X, set M(x,Zj) - v.,-v, where v 1 is the tangent line 
to the curve K(x,y) at y Q evaluated at 0, M(x,z 2 ) = v 2 -v, where v 2 
is the tangent line to the curve K(x,y) at y Q evaluated at 1, and 
M(x,z^) and M(x,z 1| ) are defined similarly in terms of curve K(x,y) at 
the point y 1 . The function M(x,z) is defined over Z by linear ex¬ 
tension. The kernel M(x,z) satisfies all the conditions of Lemma 2. 
Furthermore, if F Q (x) is optimal for player I and the game K(x,y), then 
/ x M(x,z)dF 0 (x) s 0. Lemma 2 provides an optimal strategy F*(x) with at 
most 4 points in its spectrum such that / x M(x,z)dF*(x) > 0. Put 

h(y) * /q K(x,y)dF*(x) . The optimal nature of F*(x) for the game M(x,z) 

implies that the tangent lines to h(y) at y Q and y 1 lie everywhere 
above the height v. Consequently, h(y Q ) > v and h(y 1 ) > v. Hence, 

/q h(y)dG Q (y) > v. But since every x involved in F*(x) is included 
in X, we conclude that 0F*(x) K(x,y)dG Q (y) - v. Thus, 
h(y Q ) * hCy^ = v. Therefore also, h'(y Q ) « h'Cy^ =0. In view of the 
remark (B), we deduce that h(y) > v throughout the unit interval. 

Case (b). For this case we construct the auxiliary game over X 
and Z as follows: The values of M(x,Zj) and M(x,z 2 ) are exactly as 
in case (a). Put M(x,z^) = K(x,o) - v and M^z^) ® + Ky(x,0) and 
M(x,z) for z in Z is defined by linear extension. The set X consists 
of all x for which / K(x,y)dG (y) * v where G (y) = AT + (1-<*)I . 

u u J Q 

By Lemma 2 the game M(x,z) with x in X and z in Z has an optimal 

strategy F*(x) with at most k points of increase such that 

/ x M(x,z)dF*(x) > 0. This gives for h(y) = J ] Q K(x,y)dF*(x) that 

h(o) > v and h(y Q ) > v. It can be deduced in a similar manner to case (a) 

that h(0) = h(y Q ) = v and h*(y 0 ) = 0 while h*(o) > 0. With the aid of 

remark (B) we conclude easily that h(y) > v for 0 < y < 1. 

Case (c). If the minimizing optimal strategy has the form 
G 0 - AI 1 + (l-A)I^ , then an argument similar to that employed in case (b) 

applies here to furnish the desired kind of optimal strategy for player I. 

Case (d). Let G Q (y) = AI 0 + (l-A)l 1 and let X consist of 
all x in the unit interval for which / K(x,y)dG Q (x) - v. Put for x in 
X M(x,Zj) - K(x,o) - v, M(x,z 2 ) - Ky(x,0), M(x,z^) - K(x,l) - v and 
M(x,z^) - -Ky(x,l) with a linear extension. Again, one can find an optimal 
strategy F*(x) involving at most 4 points for which / M(x,z)dF*(x) > 0. 
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It follows easily for h(y) - K(x,y)dF*(x) that h(o) > .v, h(l) > v, 
h*(0) ^ o and h'(i) £ o. Employing the definition of X yields that 
h(o) * h(l) ® v. On account of remark (B) it follows that h(y) > v for 
y in the unit interval. 

Case (e). The form of the minimizing solution is I with 

y o 

0 < y Q < 1 . We subdivide this case into four subcases. The analysis of 
case (e) is as follows: 

Case (ej) treats the situation where there exists a solution 
F(x) whose yield m(y) is convex for all ° < y < 1. The other alterna¬ 
tive is that m(y) is concave somewhere in the unit interval. For def¬ 
initeness, we take m(y) to be concave to the left of y Q and consider 
all resulting possibilities. An entirely analagous investigation applies 
if ra(y) is concave in a portion to the right of y Q . Under the given 
supposition in view of remark (B) and the fact that m(y) is always convex 
at y Q , we deduce that m(y) is convex for i > y >y Q . 

Three possibilities arise in this circumstance that m(y) is 
concave in a portion to the left of y Q . 

Case (e 2 ) examines the situation where m(y) is concave at o. 

Case (e^) treats the circumstance where there exists a 
° < y 1 < y Q for which m* 1 (y^ > 0 and m'fyj) * o and case (e^) con¬ 
siders the possibility that m"(o) > o while m'(o) > o. 

(e^. Suppose there exists an optimal F Q (x) for which * 
m(y) « /q K(x,y)dF Q (x) is convex for all y in the unit interval. Let X 
be composed of all x where K(x,y Q ) * v. We now define, a new game M(x,z) 
over X x Z as follows. For x in X, set M(x,z 1 ) « v ] - v, where v 1 
is the value of the tangent line to the curve K(x,y) at y Q evaluated 
at 0, and M(x,z 2 ) *= v g - v, where v 2 is the value of the tangent line 
to the curve K(x,y) at y Q evaluated at 1. Finally for the segment 
[z^,z^] which we choose to be the unit interval [0,1 ], we define 
M(x,z) = K^(x,z). Since the fourth derivative K^y > 0, we get that 
M(x,z) is convex on the segment [z^,z^] for each x. The function 
M(x,z) is defined on the segment [ZyZ^] and at the vertices z 1 and 
z 2 . We first extend M(x,z) to the face L spanned by z 2 , z^ and z^. 
Every point p of L not on [z^,z^] is a convex combination of a point 
z of the segment [z^,z^] and z 2 « Explicitly p » c az + (1 - *)z 2 . put 
M(x,p) - *M(x,z) + (1 - *)M(x,z 2 ). Thus M is defined on L. In an 
analagous way M can now be extended to the full simplex Z, and is 
easily seen to be convex. It now obviously satisfies the requirements of 
Lemma 2. Furthermore, the nature of m(y) implies that 

M(x,z)dF Q (x) ^ o. On account of Lemma 2, we can select an optimal 
strategy F*(x) which involves at most 4 points in its spectrum for which 
/ x M(x,z)dF*(x) ]> o. Let h(y) « K(x,y)dF*(x). An interpretation of 
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of the auxiliary game introduced yields that h''(y) > 0 , h‘(y 0 ) * 0 and 
h(y Q ) = v. Consequently, h(y) > v for 0 £ y £ 1 . 

(e 2 ) . Suppose there exists an optimal strategy F Q (y) for which 
m(y) ** Iq K(x,y)dF Q (x) is concave at 0. The set X is chosen as we did 
before for (e^. We construct M(x,Zj), M(x,z 2 ) as before while 
M(x,z 5 ) = K(x,0) - v and M(x,z^) * -Ky y (x,0) with M(x,z) extended 
linearly over Z for each x in X. An optimal strategy using at most 4 
points for the game corresponding to M(x,z) turns out to be an optimal 
strategy also for K(x,y). The details are similar to the preceding cases. 

(e,) . We assume now that there exists an optimal strategy F.(y) 

■2 1 o 

for which m(y) = J Q K(x,y)dF Q (x) has the following properties: 
m * (y 0 ) = °> m(y 0 ) = v * m (y) > v for 0 1 y < 1 > there exists a 
0 < Yj < y Q for which m' 1 ^) > o and m 1 ^) = 0. Let X comprise 
those x for which K(x,y Q ) = v. Let Z be a 4 dimensional simplex 
spanned by z ] , z 2 , Zy z ^ and z^. Let for x in X MCx^) and 
M(x,z 2 ) be given as before. Also, put M(x,z^) = v^ - v, where v^ is 
the tangent line to the curve K(x,y) at y 1 evaluated at 0, 

M(x,z^) = v^ - v, where v^ is the tangent line to the curve K(x,y) at 
y 1 evaluated at 1, and M(x,z^) = KyyCx^). Furthermore M(x,z) is 
extended linearly over Z. It follows easily that / x M(x,z)dF Q (x) > 0. 

We now verify that the optimal strategies for player II for the game with 
payoff M(x,z) cannot possess an interior pure strategy I . Otherwise, 

/ x M(x,z)dF Q (x) = 0 for it is simple to show that the value is zero and 
therefore m(y) = / K(x,y)dF 0 (x) satisfies m(y) > v throughout and 
mCy^ = v, m'^) = o and m'*^) =0 which contradicts the assumption 
made on m(y). In view of [1] and the corollary to Theorem 4 of [2], we 

can conclude, since I is on the boundary of Z, that there exists an 
z o 

optimal strategy F*(x) using at most 4 points. Let 
h(y) = I ] Q K(x,y)dF*(x). It follows that h'(y Q ) * 0, h(y Q ) = v, the 
tangent line to h(y) at y 1 lies above v for ° £ y £ l and h(y) 
is convex at y 1 . Now with the aid of remark (B) it is easy to show that 
h(y) > v throughout the unit interval. 

It remains only to consider the case where m(y) = / K(x,y)dF Q (x) 
satisfies the same properties as in (e^) except that y 1 - o. We then 
define M(x,Zj) and M(x,z 2 ) as before while M(x,Zj) = K(x,o) - v and 
M(x,z 4 ) = Ky( x,0) with x any point in the set X where K(x,y Q ) = v. 

A simple analysis with the help of the game M(x,z), shows in this cir¬ 
cumstance the existence of an optimal strategy of the desired kind. 

(e^). The final case consists of a solution F Q (x) such that 
m(y) = /q K(x,y)dF Q (x) is convex at y Q and at o in such a way that 
m*(0) >0. The auxiliary game used here is the same employed in case (b). 
An optimal strategy F*(x) using at most 4 points exists with 



168 


KARLIN 


h(y) ** / K(x,y)dF*(x) such that h'(y 0 ) - o, h(y Q ) - v, h(o) > o and 
h 1 (y Q ) >0. It follows on account of (A) that h(y) > v in the unit 
interval. 

Case (f) and Case (g). The arguments for these two cases are 
similar to the preceding. 

The proof ^ of Theorem 2 is now complete in view of the fact that 
we have treated every possibility. It Is interesting to note that the 
proof of Theorem 2 introduced some new techniques in order to exhibit the 
desired strategies. In particular, we emphasize the proof of case (e). 

In a future paper we intend to present a generalization of this 

result to the case where x ranges over a compact space and y traverses 

a k dimensional set with the condition K „(x,y) > o replaced by the 
th j••• y — 

requirement that the n term of the Taylor expansion in y should be 
non-negative. Also, the question of uniqueness of the set of optimal 
strategies can be analyzed. 

(j 5- DIMENSIONAL RELATIONS 

In this section we analyze further properties of the optimal 
strategies for the two cases considered in sections 5 and k. We deal first 
with the case where Kyyy(x,y) > o. Here any optimal minimizing strategy 
must be confined at most to two points, o and y Q or o and 1, and we 
can therefore speak about the dimension of the set of solutions for the 
minimizing players. The two possible cases are 0 and 1 dimensional 
sets. If the spectrum for the optimal minimizing strategies Is restricted 
to one point, then clearly the solution is unique for player II. 

Case (a). Let us suppose that player II has a one dimensional 
set of optimal strategies mixing the pure strategies o and y Q , with 
°< y 0 < 1 • There exist at least two optimal strategies of the form 

G - AI n + 0 - a)t and G' - A'I n + 0 - A')I V with V / A. We con- 
u o u ^o 

sider the set X of all x for which / K(x,y)dG(y) - / K(x,y)dG*(y) - v. 

Explicitly, we obtain 

A [K(x,0) - v] + (1 - A)[K(x,y Q ) - v] = 0 
VCK(x,o) - v] + (1 - A' )CK(x,y 0 ) - v] - 0 . 

As A^ A*, we find that K(x,o) - K(x,y Q ) - v. We now construct the 
auxiliary game where z consists of a one dimensional simplex spanned by 
z y and z 2 . Put for x in X M(z f s 1 ) - -X^(x,y 0 ), M(x,z g ) - Ky(x,y Q ) 
and let M(x,zh be defined on the remaining points of z by linear ex¬ 
tension. There exists an optimal F* using only two points at most. In 
view of the nature of X it is easily verified that F* Is an optimal 
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strategy for.the game given by K(x,y) 

Case (b) . We assume that player II has a one dimensional set of 
strategies using only the points 0 and 1 It can be shown as above that 
there exists an optimal maximizing strategy consisting of at most two 
points of increase. 

We have thus demonstrated the following theorem: 

THEOREM 3. If K satisfies K yyy (x,y) > 0 and 

player II possesses a one dimensional set of optimal 
strategies then player I can find a solution using at 
most two points of increase. 

In a similar manner we can obtain 

THEOREM k. If K satisfies Xyyyy(x*y) > 0 and 

player II possesses a one dimensional set of optimal 
strategies, then player I can find an optimal strategy 
with at most three points In the spectrum. 

Every case is easily handled but one. Suppose the minimizing 
strategy has a one dimensional set of solutions using y Q and y 1 with 
0 < y 0 < y 1 < 1 • Let X consist of all x where K(x,y Q ) = Kfx^y,) » v. 
An argument as in Theorem 3 shows that these are the only points x which 
need be considered. We construct the following auxiliary game defined over 
X and Z where Z Is a two dimensional simplex. Put M(x,Zj) - the 
tangent line to K(x,y) at y Q evaluated at 1 minus the tangent line 
to K(x,y) at y 1 evaluated at 1. M(x,z 2 ) = the same as above except 

the evaluation takes place at 0 and M(x,z,) = the tangent line to 

Y +Y ^ 

K(x,y) at y 1 evaluated at ° 2 1 minus v. If P is optimal for the 

game corresponding to K(x,y) then / x M(x,y)dP(x) 5 0. Thus Lemma 2 
provides an optimal strategy F* using at most 3 points of X with 
I M(x,y)dF* > 0 . One can easily verify that F* is optimal for K(x,y). 
This completes the proof. 

In the general case where Ky >>y (x,y) > 0 for n partial 
derivatives with respect to y, it seems that if the y player has a 
k-dimensional set of solutions, then the x player can find an optimal 
strategy involving at most n - k points in its spectrum. 

4 6. AN APPLICATION 

We close this note with an application of Theorems 1 and 2 to a 
class of matrices. First, it is important to note that the conclusions of 
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Theorems 1 and 2 remain valid when x traverses any compact set and where 
y ranges over the -unit interval. We consider now a class of matrices 
(a^) 1 £ i < n, 1 £ j £ m, satisfying the requirement that A k a lj . > o 
for each i where k is a fixed integer <4. We define Aa p « a p - a p-1 
for r > 0 with a -1 taken to be zero, and A k is defined by k succes¬ 
sive applications of the operator A. It is easy to show that if there 
exists a finite sequence of numbers a p (r - o, 1, n) which satisfy 

A^ a r ]> o for each r, then the function f(y) defined as f(jjj) = a p , 
r * 0, 1, m and extended by linear interpolation between the succes¬ 

sive values of r/m possesses the property that A^f(y) > 0 with the 
difference increment taken to be ~ and enjoys properties similar to func¬ 
tions for which f^(y) > o. Indeed, we sketch the proof by induction. 
When k « 1, then the above Interpolation yields a monotonic increasing 
function. If k - 2, it Is also trivial that the linear interpolation 

produces a convex function. We treat the case k = 3 . Let b ® Aa , 
o r r 

then Ab p ) 0. Let g(y) denote the interpolated convex function with 
g(-) * b p . Set g(y) s o for y < o and define f(y) = V^ 0 g(y - |) . 

It easily follows that f(y) - f(y - -) * g(y), f(~) = a p and f Is 

piecewise linear between the points £. Since g(y) is convex and the 
piecewise linear character in equal lengths of f(y) implies that a con¬ 
vex portion of f(y) cannot be followed by a concave part. This was the 
essential fact that enabled us to carry through Theorem 1 . A similar anal¬ 
ysis applies to the case k = 4. We perform the above extension for every 
row of the matrix and we secure a function K(x,y) with x ranging over 
a finite number of points i = 1, ..., n and y over the unit interval. 
.The conclusions of Theorem 1 and 2 remain valid for such a piecewise linear 
kernel. Consequently, we can find optimal strategies of the game K(x,y) 
for player I and II using at most k points and k/2 points respectively. 
Due to the linear nature of K(x,y) any point y Q can be obtained as a 
convex combination of two values jjj < y Q < r + gj with K(x,y Q ) = AK(x,~) + 
(1 - A)K(x,r + j). Thus In terms of the original matrix both players I and 
II possess solutions employing at most k rows and k columns. 

THEOREM 5 • If a ij . Is a matrix such that for 
each i > 0 for all j with k £ 4, then both 

players have solutions using at most k rows and col¬ 
umns respectively. 

Finally,•we remark that all the analogous results hold for the 
situations where Ky_ #y (x,y) < 0, ^... x (x,y) > o and K* _ #x (x,y) > o. 
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NOTES ON GAMES OVER THE SQUARE* 

I. Glicksberg and 0. Gross 

INTRODUCTION 

In attempts to find methods of solving a fairly wide class of 
(2-person, zero-sum) games over the unit square, real success has been at¬ 
tained in only two cases: (l) Games in which the problem is essentially a 
finite-dimensional one, notably those with polynomial or polynomial-like 
payoffs [1], and (2) games having solutions which are absolutely continuous 
(or very nearly so) and can be sol'/ed via differential or integral equa¬ 
tions [2,3]. These latter games ail feature discontinuities in the payoffs 
or their derivatives. Attempts to fiiiG a tractable though wider class than 
that of polynomial games have led, naturally, to Investigation of the class 
with rational payoff. 

The object of these notes is to present some simple examples and 
results which, though of meager intrinsic interest, may serve as some guide 
in future investigations. In $ 1, we give a simple consequence, due to one 
of the writers (0. Gross), of Tarski*s decision theory of elementary algebra 
[4], together with an example, to show that rational games do not share with 
polynomial games the property of always having step function solutions. In 
$ 2, we give an example of a game with rational payoff in which the unique 
optimal strategy for each player is based on a dense countable set. From 
this we conclude that neither of the methods mentioned above is completely 
applicable to the class of rational games. In the remaining section, we 
give explicit constructions to show that even in the class of games with 
payoffs in one may obtain any given pair (f,g) of distributions as 

the unique solution of an element of the class. 

§ 1 . ALGEBRAIC GAMES WITH TRANSCENDENTAL VALUES 

Let P be a 2-person zero-sum game for which the pure strategy 
spaces, S 1 and S 2 ,. and the payoff function M, defined over S 1 x S 2 , 
are definable in Tarski*s system of "elementary algebra" [4]. Suppose, 

*- 

The preparation of this paper was supported by the RAND Corporation. 
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also, that P has a value which is a transqendental number. We can then 
conclude that there is no optimal strategy for either player consisting of 
a step function (i.e., a distribution in which the probabilities are all 
concentrated on a finite set of points). For suppose the contrary for one 
of the play’ers, say the maximizing one. Then, for some positive integer m, 
the value of is given by 


v - max min 

<V •••• ^ 

x i. 6 S i 


Si-i •*■!**( 


where is the set of all m-tuples <>^ , ..., such that jjl± > o 

for i « 1, ..., m, and ■ 1 But, according to [4], v would 

be algebraically definable, and it is a principal result of [4] that every 
algebraically definable number is algebraic. 

In particular, our result applies to any game over the square 
with transcendental value, in which M is a continuous rational function 
with integral coefficients. 

EXAMPLE. Take 


M(x,y) - 

(1 + xy) 


3, - tx| 0 < x < 1}, 


and 

Here, v 
given by 


4 

7 r> 


s 2 = (y|o < y < i). 
and a pair of distribution 

, f*(x) - ^ arc 

g (y) - tt arc 


functions yielding this value is 

tan Vx 

°<yi’• 

tan Vy 


Thus, in this game, there is no step function optimal strategy, for 7T is 
a transcendental number. We mention, as an aside, that one can show by 
slightly more laborious methods, that the above solution Is the only one 
for this game. 


f 2. RATIONAL GAMES WITH PATHOLOGICAL UNIQUE SOLUTIONS 

In this section we shall construct a game with rational payoff in 
which the solution is uniquely given by a pair of distribution functions, 
each of which is based on a countable dense set in (0,1). The following 
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simple facts form the germ of the construction: 

(a) If, for any continuous function N on the unit square, and 
any pair (f,g) of strategies, one forms the function M by means of 


M(x,y) N(x,y) 


J* N(x,y)df(x) - J 


N(x,y)dg(y), 


then the game with payoff M has (f,g) as a solution. 

(b) If R is any rational function on the square, then 


J[R(x,y) - £ R(*(x),y>] d (^o ^(n) ( } (x) ) 

(where <|>: [0,1] -> [0,1] is a polynomial, its n-th iterate, and 

I a is a function which is o for x < a and 1 for x > a) is again a 
rational function; for it is precisely 


So pwT t R (^ n ^ x o)>y) - £ R(<t>^ n+1 ^(x 0 ),y)] = | R(x 0 ,y) 
since the series telescopes. 

(c) The polynomial <|)(x) = 4x(1 - x) will provide us with a 

dense set of iterates for certain x n . 

u (k-1 

Only (c) requires any proof, and if we set x^ = (x Q ), then 

x k + i - 4 x k (1 - x k 5 ■ 1 - (1 - 2 x k )2 ' 


and 


1 - 2x k + i - 2 <’ - 2x k )2 - 1; 

consequently if we set u^ = 1 - 2x k , u Q = cos 2tfe 0 , then 

u k = cos 2 k (2Tre 0 ), 


or 


1 - COS 2 k ( 27^0.) 

X k-2- 


Clearly then we need only select an x Q for which the numbers 
(2 k e 0 ) are, modulo 1, dense in (0,1). This is equivalent to the occur¬ 
rence of every finite sequence of o * s and 1 * s as a segment In the 

a i a 2 

binary expansion of e Q (i.e., if e Q * + jp + ... then any sequence 

of n zero's and one's may be found as ..., a^^) for some k); 
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such numbers e Q (and x Q ) are dense in ( 0 , 1 ), and there are a continuum 
of them. 

Now let R be a rational function of a single variable. If we 

form 

Y(x,y) - R(xy) - ^ R(<t>(x)y) - \ R(x$(y)) + ^ R(<l>(x)(|>(y)) 

where <p(x) = 4x(l - x), then by (b) 

Jr(x,y)d ( psr l $(n)(x ) (x) ) = i R(x oy) - i:H(xo»(y)). 

Consequently the game with payoff M defined by 

V(x,y)df(x) - JV(x,y)dg(y), 

where f = V -U- I , , , g - V —J—- I , > , Is a game with 

2 n+ ' 0 (n) (x o ) s n+1 $ n (y 0 ) 

rational payoff having the pair (f,g) as a solution. 

For definiteness, let us specifically set R(t) - 2 \ t * so 
M has the form 

M(x,y) = 2 + xy ” 2 2 + 4xy(1-x) “ 2 2 + Vxy(1 -y) + ^ 2 + 16 xy(l -x) (1 -y) 

I 1 1 1 1 1 l 1 

”22 + x Q y IT 2 + 4x Q y(1 -y) "22 + xy Q 4" 2 + 4xy 0 (l -x) 


M(x,y) «= F(x,y) 


/ 


where we choose x Q and y Q so that their iterates are dense. This, then, 
is the example and we need only show (f,g) to be the unique solution. 

Since, in the example, g places positive weight on a aense set 
of points, we must have, for any optimal f', / M(x,y)df*(x) = v for all 
y. Consequently 


x 


Y(x,y)df'(x) 


-J 


y(x,y)df (x) 


■XX 


y(x,y)df'(x)dg(y) + v « c 


or / Y<x,y)d(f' - f)(x) = o. But 


Y(x,y) - R(xy) - \ R(<t>(x)y) - \ R(x$(y)) + | R(<t>(x)i|>(y)) 

" * So t(xy) n - j(|(x)y) n - |(x<|>(y)) n + ^(0(x)<i(y)) n ] 

- - So <- - 5 «D(x)) n ][y n - i(«(y)) n ] 


and thus 



GAMES OVER THE SQUARE 


177 


- J) ( - ^ n+1 h n [ y n - ^4>(y)) n ] - c 

* 

for all y, where h n = / tx 11 - ■—( 0(x)) n ]a(f' - f)(x). Hence, for all 
m and y, 

- c = Xo V ( * ( “ )( y ))D - 

so that 

- 2C = 2^0 7 Xn=o <- ?) n+1 V<4> (m) <y» n 

" S n : 0 (- f) n+1 *n 2n£o pst (4> (m> (y) ) 1A 

= 2 n : 0 <- ^) n+1 v n . 

for all y, and h^ = o for all n (obviously h Q « o). However, th±3 
implies f» = f, for the sequence of functions { x n - ^-(<|)(x) ) n ) n=0 1 
is closed in C(0,1) (i.e., any continuous function defined on [0,1] 

may be uniformly approximated to within £ > 0 by a finite linear combina¬ 
tion of these functions). This is most easily seen by noting that for a 
given continuous F on [0,1] there exists a continuous function G 
satisfying F(x) - G(x) - tj G(4>(x)) given by 

G(x) - Sn =0 (^) n F(4> (ri) (x)) . 

Consequently, if £ > 0 be given, one can find coeficients a Q , ..., a^ 
for which 

IG(x) • Sn=0 a n xn| < £ o < x £ 1, 
by the Weierstrass Approximation Theorem, so that 

IG(t>(x)) - ^ n =0 a n «t>(x)) n | < £ 
and 

IF(x) - 2n=o a n txI1 - ) n J | < (1 + i)£ 

for all x . 

The same arguments show that g is the unique optimal strategy 
for the minimizing player; thus the solution of the game is uniquely given 
by the "pathological" pair (f,g). 


- l(0 (m+1) (y)) n ] 
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f }• GAMES WITH GIVEN UNIQUE SOLUTIONS 

In this section we shall construct for each strategy pair (f,g), 
a game having (f<g) as Its unique solution. 

Case I. Neither f nor g a step function* 

One need only set 

M(x,y) - 2 ” n ( xI1 - f n ) (yn ‘ Sn 5 

where f n and ^ are the usual power moments of f and g. For clearly, 
f and g are optimal and v - o for the game with payoff M; moreover if 
f• is any optimal strategy for the first player then 

J*M(x,y)df(x) = X 2 " n(f n " f n )(yI1 " “ 0 

for y in the spectrum of g (which by assumption is an infinite set) and 
thus for all y, so that f^ « f n or f 1 ■ f. Similarly g is unique. 

This simple construction must be modified if either f or g 

(or both) are step functions. Indeed, we have several cases. 

Case II. f not a step function, g a step function with a step 
interior to ( 0 , 1 ). 

Let 

6 - X j»0 fj 1 ?,' 0 " y 0 < y 1 < • • • < y k “ 1 ' P\ t °- 

' We define the payoff M of our game by 

-TT (y - y j )_2 

M(x,y) - 2 )i£i 2 _n (x n - f n )t(y - y,) 2n-1 - g 2n .il + e J 

where f n - / x n df(x), g 2n _, - / (y - y, ) 2n-1 dg(y). Obviously f and g 

are optimal and v - o. Now if f 1 is optimal for player I then 

, -IT (y-y .) -2 

J M(x,y)df*(x) - Xn£i 2 " n(f n “ f n )t(y ' y i )2n ~’ - S 2n -i 1 + ® J > 0 

and since p^ P o, 

J*ll(x,y 1 )df»(x) - ^ 2 _n (f^ - f n )(-g 2n .,) - o 

so that 

-TTty-y^ -2 

X 2 _n (f^ - f n )(y - y,) 2n_1 + e J 

is nonnegative and vanishes at y 1 . But clearly this quantity changes sign 



GAMES OVER THE SQUARE 


179 


at y 1 if any coefficient in the series is non-zero; hence f • « f, and 
f is the unique optimal strategy for player I. 

-Tny-yj )" 2 

Since /M(x,y)df(x)»e ^ , which vanishes only at the 

points yany g* optimal for player II must be based on these points, 
and 

8' “ Sj=0 !®j X yj- 

Since f is not a step function we conclude, as in Case I, that 

0 - 22- n (x n - f n )(g2 n _, - g 2n _,) = Jl 

hence &2n-\ m g 2n-l for a11 n ^ °> that is 

«> Vo - -Vyf " 1 - - y ,) 2 


M(x,y)dg* (y), 


\2n-i 


Now if yj ^ 2y 1 , j - 2, 3, k, this implies /9j - fly 

j * 0, 2, k, or g* * g; for since the positive numbers 

y i * y 2 ~ y i ' •••> y k “ y i > are a11 distinct, If we divide (1) by the 

2n-i st power of the largest of these and let n —> «, we obtain 

jZ* - *= 0. Deleting this term and repeating the argument yields 

=0, and thus finally = Py j = 0, 2, k. 

In case y. - 2y. for some j we need only find a (1-1) con- 
J 1 t i 

tinuous mapping f for which /°(yj) * yj p 2y 1 . For, forming the game 
with unique solution (f,g*), g' = Xfij I y » 8Ln ^ i Payoff M as has been 

J 

done above, we find that the game with payoff M(x,f _1 (y)) has the unique 
solution (f,g). In the following cases we shall assume that y^ / 2y 1 . 

Case III. Both f and g step functions with a step interior 

to (o,i). 

In this case we have f - X±L] a i J x 9 6 - X j«o fi j*y 9 

i j 

0 * x 0 < X 1 < • • • < x k " 1 > 0 - y 0 < y l < • • • < y ! • 1 ' / 0 / P\ • 


We set 


M(x,y) - ^ 2" n [(x-x,) 2n ' 1 - - g 2n _,l 


+ e 


(y-yj )“ 2 -Tr(x-x ± ) 


-2 


- e 


where 
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f 2n-1 “ / (X _ x l )2n "' df(x) » 8 2n -i = / (y ' y l )2n '’ d 8 ( y>- 
Here, we have 

-yu-yj)- 8 . 

Mdf - e J , I Mdg « e 1 

so that optimal strategies may only be based on the or y^. If f' is 

optimal, then 

-"IT (y-y.O-s 

o< X 2 " n(f 2n-1 - f 2n-i )[( y- y i )2n "' - Ksn-I ] + e J 
and since ft, ^ o 

0 = ^ 2 n ( f 2n-i " f 2n-l ^“ g 2n-i ^ * 

Consequently 

-'TTCy-y^" 2 

°< 2^4-, - f 2n-l )( y- y i )2n '’ + e j 

and as before we conclude fg n _ 1 = f 2n __ 1 • Since we may assume x^^ ^ 2x 1 , 
we conclude f 1 « f as in Case II. The same argument shows g to be 
unique. 

Case IV. f a step function with step interior to (0,1) and 
g - pl 0 + (1 0 < />< 1. 

Here we set 

M(x,y) - 2n”l 


Again (f,g) is a solution, v « o, and player I must play the points x^ 
and player II must play (0,1 ). , For any optimal g* the previous argument 
yields (l - ^*)sin 1 = (l - yS)sin l or g' « g. Moreover, if f* is 
optimal, since 0 < p < 1, 

2 2 ^ f 2n-l “ f 2n-l^“ ^ 1 “ A)sin i) * o 


S 8 " n(f 2n-i f 2n-l )yn sln \ + e y2(1_y)2 > 0. 


2" n [ (x-x, ) 2n_1 - fg n _, ] (y 11 sin^ - (1 - fi )sin 1) 


-5— 11 —o -TTCx-x,)- 2 

y O-y) . e i 1 


and -thus 



GAMES OVER THE SQUARE 


181 


Now the first non-vanishing term of the series dominates all other terms 
of the sum in a neighborhood of zero; but by setting 

rp- = 2nrrr + -V - 2m7T - 
y ” y m 

we find that the first non-vanishing term has the form 

? ' n < f 2 n-l - f 2n-i , »£ and ' 2 ‘ n(f 2n-i ’ 

at y m and y^ respectively, so that the whole sum changes sign near zero 

if f|n_i ^ f 2n-l for some n ' Thus f 2n-l = f 2n-i tor a11 n and f 
is again unique. 

Case V. f not a step function, g = pi Q + (1 - fi)ly , 0 < p < 1 . 
In this case we modify the payoff of the previous case to 


“2 2 

M(x,y) = ^ n ", 2‘ n (x n - f n )(y n sin i - (1 - /Osin 1) + e y 

where f is the ordinary moment, / x n df(x). Again (f,g) is a solution, 

v = 0 and player II may play only (0,1} . Since any optimal g‘ must 

yield 0 = / M(x,y)dg(y) as in Case I, g is unique as in the preceding 

case, f is the unique optimal strategy for player I by the arguments of 

the preceding case. 

Case VI. f - dI Q + (1 - cOl,, g = pi Q + (1 - ^)I,, 0 <«*,/< 1. 
We set 

M(x,y) = - /Sx + (2 - <Oy + x 2 + (1 - d - ^)xy - y 2 . 

Observe that M Is strictly convex in x and strictly concave in y. 

Hence any optimal strategy for either player must be based on the points 
0,1 . Consequently any solution (d I Q + (1 - d )Ij, p I Q + (1 - )I } ) 

of the game with this payoff must yield a solution ((<**, 1 - ot*), 

(/,1 - p)) of the finite game with payoff given by the 2x2 matrix 

/M(o,o) M(0,1 )\ / 0 1 - <^ \ 

\M(l ,0) M(1 ,1 )/ V - P 1 - - ?) 

However, it is easily verified that this game has the unique solution 

((d,1 - *), {p, 1 - p)). 

Case VII. f arbitrary, g * I Q . 

Here we let 
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M(x,y) - 5) 2 ’ n (x n " t n }^ Xl sin f * e " y 

where f n Is the ordinary n-th moment of f. Again (f,g) is a solution 

-2 , 

v - 0, and g is unique since / Mdf * e“ y . Moreover, if f is 
optimal, we conclude as in Case IV that f - f n , or f » f. 

Since we may interchange players and the end points 0 and 1, 
all cases have been covered. 
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ON RANDOMIZATION IN STATISTICAL GAMES WITH k TERMINAL ACTIONS 1 
David Blackwell 


f 1 . SUMMARY 


In a two-person zero-sum game in which a player receives partial, 
i.e., statistical, information about his opponent's strategy after which he 
takes one of k terminal actions, any randomized strategy is equivalent to 

a mixture of a countable number of pure strategies in the proportions 
n-l 


/ k-l i 


1 


n = i, 2, 


non-negative numbers z 


The proof uses the fact that for any k 
1 there is a partition of 


Z k with 2* z i 


the set of positive integers into disjoint sets S 

2 A n “ z-s- 
nes, n J 


s k 


such that 


$ 2. SPECIAL AND GENERAL RANDOMIZATION 


Many zero-sum two-person games. Including statistical multi-de¬ 
cision problems with a fixed sampling plan, have the following structure. 
Player I chooses a point from a set Si. A point x is then chosen 
from a space X according to a probability distribution P^,, defined on a 
Borel field "6 of subsets of X, and x is announced to Player II. 

Player II then chooses one of k terminal actions, which we denote simply 
by the integers 1, k and incurs a loss L(a>,x,i), supposed 

6-measurable for fixed o»,i. 

Thus, a pure strategy for I is an cu gD, a strategy for II 
Is a partition &- (A 1 , ..., A k ) of X into k disjoint sets 
Ai, ..., A k , A ^ G #, where Aj specifies the set of x's for which II 
proposes to take action j. II's loss Is then 

R(w,a) = f L(w,x,j)dP w (x). 

J Aj 

A mixed strategy for II is a probability distribution Q over some Borel 


1 The preparation of this paper was sponsored by the Office of Naval 
Research. 
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field 8 of subsets of the set Y of fi-measurable partitions CL of X. 
II*s loss from Q is 

R(o),Q) - J R(w,a)dQ(&) 

“ Jlaj(x»<WL(w,x, jJdP^x) ]dQ(a). 


where aj(x,<X) is the characteristic function of the set Aj of the 
partition d,. We shall suppose that aj(x,<3l) is measurable with respect 
to each measure P^xQ, i.e., that Q assigns, for each P w , a definite 
overall probability of taking terminal action j. Then 


R(w,Q) 


2j=i ^ aj(x,a)dQ(a)]dP w (x) 

\ L(w»x, j)^j(x,Q)dP M (x), 


where <£j(x,Q) = \ aj(x,a)dQ(a) is the probability under Q of taking 
action j when x is observed. 

Thus any mixed strategy Q determines a set $ of fi-measurable, 
non-negative functions l^(x)) with ^ £j(x) = 1 for each x such that 


R(a>;Q) - R(o>,$) = V L(cj,x, JJ^-txJdP^fx) . 


Now any family <£ , whether arising from a Q or not, can be considered as 
constituting a mixed strategy, in which the mixing is done after x is 
observed, with action j being chosen with probability ^-(x), and the 
expected loss from £ is the function R(cu,$) defined above. The rela¬ 
tion between Q-raixlng, i.e., mixing before x is observed, and ^-mixing, 

2 

i.e., mixing after x is observed, has been investigated by Wald [2], 

Wald and Wolfowitz [3], and Kuhn [1], who have shown, under various hy¬ 
potheses, that the two kinds of mixing are equivalent. For the special 
case considered here, we obtain the even more precise result that both are 
equivalent to mixtures of a countable number of pure strategies in the 

k-l n “ 1 l 

proportions * n - (==£-) g and that the pure strategies may be chosen 

independently of L(w,x,j). We have already seen above that every 
Q-mixture is equivalent to a ^-mixture, with £j(x) = jaj(x,(i)dQ(a) 
independent of L(<o,x,j), so that it suffices to consider ^-mixtures. 


o 

Numbers in square brackets refer to the bibliography at the end of this 
paper. 
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$5- THE MAIN THEOREM 

For ^-mixtures, we prove the 

THEOREM. For any 5 , ..., 0^) there is a 

sequence ¥ n « (Y nl , , where each is 

the characteristic function of a, ^-measurable set ana 
Sj* V^nj “ 1 for a11 n,x, such that 

w n ~i ^ n Y nj .(x) = 0j(x) for a11 i> x > wher * e 
v 1 n “ 1 1 

* n - (^ L ) p so that, for all L(co,x,j), 

R(oo,£) - j L(<J,x, j)Yj(x)oP^(x) 

“ ST A n ( Sj=i J L(u,x,j)y n j(x)aP u (x)) 

= S'' n R( “'' 2 'n ) = «<».♦*). 

where 0* is the mixture of the pure strategies 
••• in proportions , ^ 2 , ... 

PROOF. We define 0 n j, Y n j inductively as follows: 0^. = 0^., 
0* = max 0 1 j - smallest j with 0 1 • = 0*, f } j - 1 , ^ j = 0, j / . 

If 0^., Yjj have been defined for i < n, define 0 n j = 0j - 

0* = max 0 nj ., j n = smallest j with 0 nj . - 0*, - 1 , Y nj . = 0 for 


j ^ J n * 

Since 


V k 


1-1 i T lj'' 

it Is sufficient 

to show 

that 0 

J > i'w Vij 

for 

j = 1 

> • • 

k, which 

is equivalent to 

0 . > 0 

for all 

n, j . We prove 0 nj . 

> 0 

for 

all n, j by 

induction on n; 

clearly 

*ij> 0 

for all j; 

suppose 0 n j 

> 0 

1 for all j. 

We have 


^n+i j 

^nj “ ^ n^nj * 

Since 

v . = 

y nj 

0 

for j / j n . 

*n+lj mij £ 

for 

J ^ J*n' 

For J * 

^n+1 j 

= 0 
y n 

V 

and we must show 0* )> A n » 

We have 


w ♦nj “ \ 33 k ^n' 30 that m ^ x ^nj ^ ^n ^n' Tllis coin P letes the 

J 

proof. , 

The sequence A n ® ^ (=*£—) I s not the only sequence which can 
be used; It does have the advantage that the only random mechanism required 
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is one which will select one of the integers 1 , 2 , ..., k with equal 
probabilities 1/k; the probability that integer 1 is selected for the 
first time at the nth trial is exactly A n * Moreover, if is any other 

N 

usable sequence, M n < 2? A n “ 1 ' for a11 30 that 

converges faster than Formally stated we haves 

if M n > 0 , x°] >Si “ 1 ^ for ever y set of k 

non-negative numbers x 1 , ..., x k with * 1 > the 

series c&n be split into k disjoint subseries 

whose sums are x 1 , ..., x k respectively, then 

S?/*n < 1 - (ir) N for a11 N - 

PROOF. We may suppose >>u 2 > ... . If N is the smallest 

N N-1 

integer for which >u n > 1 “ have yu N > ^ (^g-) • Con- 

v-i N 1 v-i N" 1 

aider x 1 « 1 - (=^-) , x^ *■ ^ (-^—) i » 2 , ..., k. Since 

••• > x ± for i > 2, the set x ^ cannot he represented, for 

>a 1 , ..., ju^ could go only into the subseries for x 1 and their sum 
exceeds x 1 . 


$ 4. AN EXAMPLE 

We give here an example of a game of the type described above in 
which any minimax strategy for II actually requires the mixture of a 
countable number of pure strategies. We choose -H-* {0 ^ l), 

X - (0 < x £ , P^ [min (u>,l - o>) ] « 1, k - 2, L(oj,x,i ) « 2 , 1 , or 0 

according as <*) is <, -, or > L(o*,x,2) = l, or ~ according 

as u) is <, ~, or > The game is one in which Player II, seeing x, 
knows that I has chosen one of the two strategies u> - x, - 1 - x, and 
has available two actions, 1 and 2 . The payoff is chosen so that the 
resulting game has value 1 and II must mix 1 and 2 in proportions x, 
1 - x for x < £ in order to achieve this value. No mixture of a finite 
number of pure strategies can achieve this result. Formally, any ^-mixture 
for II Is specified by $(x) - ^(x), since $ 2 « 1 - ♦ 1 . Any $ with 
0 < £ 1 for all x determines a 5 , the characteristic functions $ 

correspond to pure strategies, and finite linear combinations of character¬ 
istic functions correspond to mixtures of a finite number of pure strate¬ 
gies . We have 




R(W,«) - 2(>(W) + !=2g [! . «,(«)], 1 
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according as u> Is <, -, or > The choice <|>*(x) - x yields 
R(cj,<|>*) » l for all <J, and, since R(^,4)) - 1 for all the value 

of the game is 1 . Thus any minlmax <t> for II must have R(o>,<&) < l for 
all co. For <o < this yields <|> (co) < co; for to > 1, this yields 
$(1 - (o) > i - co, so that <J>(x). - x for x < ^. Clearly $(x) is not 
representable as a finite linear combination of characteristic functions, 
since any finite linear combination of characteristic functions assumes 
only a finite number of values. 

To exhibit as X^ where A n - 2“ n 811(1 

is a characteristic function, we choose for <t> n (x) the n-th digit in the 
binary representation of x. 
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Part III 


GAMES IN EXTENSIVE FORM 


The core of our Intuitive notion of a game seems to be the suc¬ 
cessive presentation of alternatives to the players with varying degrees of 
Information, or to chance devices with fixed probabilities, culminating In 
terminal situations with preassigned payoffs. Von Neumann has applied the 
name "games In extensive form" to his original formalization of this con¬ 
cept in terms of persona} and chance moves, patterns of information, plays 
and their associated payoffs. Through the Introduction of pure strategies 
this natural game apparatus disappears and only payoff functions defined 
over strategy vectors remain. The resulting form of a game, which Is an 
ordinary matrix with - real entries in the zero-sum two-person case, is 
called the "normalized form." It Is peculiarly suited to the proof of 
theorems which hold for all games, while the extensive form serves to 
separate games into characteristic types. Thus, the normalized form has 
been a tool of great theoretical importance In establishing the existence 
and classification of solutions for all zero-sum two-person games, while 
the only hope of utilizing the individual properties of such games as 
Chess and Poker for their solution lies in their extensive form. 

With one major exception, games in extensive form have been 
neglected in the press of research on games In normalized form. This 
exception Is the theorem which states that every zero-sum two-person game 
with perfect Information possesses a solution in pure strategies (see 
Theory of Games and Economic Behavior, p. 112, and for historical interest 
a paper of E. Zermelo listed in the Bibliography at the end of this Study). 
This perfect-information theorem still retains its topical importance 
(Papers 11, 12 and 13 all deal, in part, with its extensions and ramifica¬ 
tions) and also points the way to the role of extensive games in analyzing 
the effects of varying the patterns of information. In PAPER 11, 

H. W. Kuhn introduces a new formalization of extensive games with precisely 
this object in mind. His is essentially a geometric model, mirroring the 
successive presentation of alternatives by the branching of a topological 
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tree and reproducing the patterns of information as partitions of the 
vertices of the tree. With this scheme, he extends the theorem cited above 
to general n-person games, proving that every such game with perfect 
information has a Nash equilibrium point in pure strategies. In addition, 
another problem of information is treated, that of the efficacy of behavior 
strategies. A "behavior strategy" can be viewed as a local randomization 
on the occasion of a choice rather than the total randomization of pure 
strategies made before a play by means of a mixed strategy. Kuhn shows 
that, when "perfect recall" prevails, behavior strategies can be used with 
the same effect on the payoff as mixed strategies. Thus, games such as 
Poker can be legitimately solved by means of behavior strategies — with 
evident computational advantages. 

Using the same geometric model, N. Dalkey considers In PAPER 12 
the effect on the normalized form of a game of varying the information 
partitions. In a game without perfect Information the rules do not inform 
a player of the precise nature of the situation that prevails when he is 
called upon to make a choice. Instead, they inform him that the situation 
Is one of several possible ones. By an "inflation" Dalkey narrows the 
number of possibilities, increasing the accuracy of the information, and 
Incidentally, the number of pure strategies. The only restriction on the 
.inflation Is that the resulting information be no more precise than the 
Information given by the rules, combined with whatever knowledge of the 
situation the player can gain through the use of a pure strategy (in 
general, the choices dictated by his strategy may prevent many situations 
from arising!)* The result of the successive application of this process 
until no further inflation Is possible is called the "complete inflation" 
of a game. Dalkey shows that two games which differ only in information 
have the same normalized form (up to repetition of strategies) if and only 
if they have identical complete Inflations. He also finds the necessary 
condition for the validity of the perfect-information theorem — namely, 
that the complete inflation of the game in question permits each player to 
know everything his opponents knew and did, previous to his own choice. 

Since the known proofs of the perfect-information theorem are 
based firmly on the finiteness of the games involved, it Is appropriate to 
ask if the result carries over to the infinite case. D. Gale and 
F. M. Stewart answer this question negatively in PAPER 13* Precisely, they 
exhibit an infinite game with perfect information that possesses no solu¬ 
tion in pure strategies. Positive results are obtained by observing that 
the set of plays of a game possesses a natural topology. The authors then 
consider "win-lose" games, that is, games in which player I wins a constant 
amount on a subset 3^ of the plays and loses the same amount on the 
complement. If Sj is open or closed in the natural topology of the plays, 
or in any finite intersection of open and closed sets, then the game (with 
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perfect information) has a solution in pure strategies. A number of other, 
more detailed, results are obtained and several open problems are proposed. 

PAPER 14 by G. L. Thompson continues the study of behavior 
strategies in an arbitrary game. He introduces the notion of a "signaling 
strategy," which is a pure strategy cut down to the information sets on 
which the player is required by the rules to forget something that he knew 
or did. Thompson shows that a combination of signaling strategies and 
associated behavior strategies suffices to produce any payoff attainable by 
mixed strategies and hence to provide a means of solution. In PAPER 15 he 
applies these concepts to the solution of a model of Bridge, considered as 
a two-person game. The model has the usual four players and four suits, 
but just two cards (ace and king) In each suit. There is no bidding, so 
only the playing characteristics of Bridge remain. To achieve the mlnlmax 
value In no trump It is necessary for East-West, South being the declarer, 
to use privately randomized signaling with respect to West's initial lead 
from a pair of kings. If one considers such private signaling as contrary 
to Hoyle, it would seem necessary to regard Bridge as a four-person game 
with enforced coalitions or else as a two-person game with announcements of 
pure signaling strategies included as preliminary moves In the extensive 
form. 

In PAPER 16 J. W. Milnor analyzes a situation which appears in 
many board games, including Che33 and the Japanese game Go. In these games 
one can measure the "incentive" to move at any particular configuration by 
imagining the possibility of passing instead. Also, in the end play of such 
games (particularly Go), the entire game may become a "sum" of essentially 
independent games, so that the problem confronting a player is not only how 
to move but in which game. Milnor shows that the "sum" is an axiomatic 
group operation and that the "incentive" gives a natural metric for the 
group. 


H. W. K. 
A. W. T. 




EXTENSIVE GAMES AND THE PROBDEM OP INFORMATION 
H. W. Kuhn 1 


In the mathematical theory of games of strategy as described by 

2 

von Neumann and Morgenstern, the development is seen to proceed in two 
major steps: (1) the presentation of an all-inclusive formal characteriza¬ 
tion of a general n-person game, (2) the introduction of the concept of pure 
strategy which makes possible a radical simplification of this scheme, re¬ 
placing an arbitrary game by a suitable prototype game. They called these 
two descriptions the extensive and the normalized forms of a game. As 
noted there, the normalized form Is better suited to the derivation of 
general theorems (e.g., the main theorem of the zero-sum two-person game), 
while the extensive form exposes the characteristic differences between 
games and the decisive structural features which determine those differences. 
Since all games are found in extensive form, while it is practical to 
normalize but a few, it seems desirable to attack the completion of a gen¬ 
eral theory of games in extensive form. 

First of all, this paper presents a new formulation of the ex¬ 
tensive form which, while appearing quite natural intuitively, covers a 
larger class of games than that used by von Neumann. The use of a geometri¬ 
cal model reduces the amount of set theoretical equipment necessary and 
clarifies the delicate problem of information. After the definition of 
pure strategies. Theorem 1 removes the redundancy found in a direct defini¬ 
tion. Theorems 2 and 3 characterize the properties of a natural decomposi¬ 
tion of many games Into a subgame and a number of difference games. They 
represent a generalization of the theorem that every zero-sum two-person 
game with perfect information has a solution in pure strategies. Theorem 4 
presents a positive criterion that a game be solvable In behavior strategies, 
a method that presents extreme computational advantages over mixed strate¬ 
gies in many cases. 


^he preparation of this paper was supported by the Office of Naval 
Research. 

2 von Neumann, J. and Morgenstern, 0., The Theory of Games and Economic 
Behavior, 2nd ed., Princeton, 19^7* 
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Throughout the paper, passages which serve as motivation, in¬ 
terpretation, or heuristic discussion are placed in brackets, [...]. This 
is done to emphasize the independence of the definitions and proofs of 
these sections. 


$ 1 . THE EXTENSIVE FORM OF A GAME 

DEFINITION 1. A game tree K Is a finite tree 
with a distinguished vertex o which is imbedded in 
an oriented plane. 5 

[The concept of a game tree Is Introduced as a natural geometric 
model of the essential character of a game as a successive presentation of 
alternatives. The distinguished vertex and the imbedding are devices which 
facilitate the arithmetization of the notion of strategy. Before proceeding 
to the definition of a game, it is necessary to present some general techni¬ 
cal terms associated with a game tree; It Is important to remark that, 
although these terms are taken from common parlance, their meaning is given 
by the definitions.] 

TERMINOLOGY: The alternatives at a vertex X £ K are the edges 
e incident at X and lying in components of K which do not contain o 
if we cut K at X. If there are j alternatives at X then they are 
Indexed by the integers 1, ..., j, circling X in the positive sense of 
the orientation. At the vertex 0, the first alternative may be assigned 
arbitrarily. If one circles a vertex X ^ o in the positive sense, the 
first alternative follows the unique edge at X which is not an alternative 
The function thus defined which Indexes the alternatives In K will be 
denoted by V; thus, v(e) Is the index of the alternative e. Those 

k 

vertices which possess alternatives will be called moves ; the remaining 
vertices will be called plays . The name play will also be used for the 
unique unicursal path from o to a play when no confusion results. The 
partition 5 of the moves into sets Aj, j - 1, 2, ..., where Aj contains 
all of the moves with j alternatives, will be called the alternative 
partition . A temporal order on K is defined by X < Y If X lies on Wy 


5 A graphical representation of a game by a tree has been suggested by 
von-Neumann, loc . cit., p. 77; however, he only treats the case of games 
with perfect Information. 

L 

It is important to make a clear distinction between our ‘'moves" and those 
of von Neumann. Precisely, a von Neumann move is the set of all moves of a 
given rank in our sense. 

5 In this paper a partition means an exhaustive decomposition into (possibly 
void) disjoint sets. 
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the unicursal path joining 0 to Y; it is a partial order. The rank of 
a move Y is the number of X such that X < Y or, equivalently, the 
number of moves X £ Wy. 

DEFINITION 2. A general n-person game P is a 
game tree K with the following specifications: 

( I) A partition of the moves into n+l indexed 
sets P Q , P 1 , .P n which will be called the player 
partition . The moves in P Q will be called chance 
moves ; the moves in P^ will be called personal moves 
of player i for i = 1, ..., n. 

(II) A partition of the moves into sets U 
which is a refinement of the player and alternative 
partitions (that is, each U is contained in P i n Aj 
for some i and j) and such that no U contains two 
moves on the same play. This partition is called the 
information partition and its sets will be called 
information sets . 

(III) For each U C P Q n Aj, a probability 
distribution on the integers l, ..., j, which assigns 
positive probability to each. Such information sets 
are assumed to be one-element sets. 

( IV) An n-tuple of real numbers h(W) ■ 

(h^W), ..., h n (W)) for each play W. The function 
h will be called the pay-off function . 

[How is this formal scheme to be Interpreted? That is, how is a 
general n-person game played? To personalize the interpretation, one may 
imagine a number of people called agents isolated from each other and each 
in possession of the rules of the game. There is one agent for each in¬ 
formation set and they are grouped into players in a natural manner, an 
agent belonging to the i th player if his Information set lies in P^. 
This seeming plethora of agents is occasioned by the possibly complicated 
state of information of our players who may be forced by the rules to 
forget facts which they knew earlier in a play. 6 

A play begins at the vertex o. Suppose that it has progressed 
to the move X. If X is a personal move with j alternatives then the 
agent whose information set contains X chooses a positive integer not 
greater than j, knowing only that he is choosing an alternative at one 


6 It has been asserted by von Neumann that Bridge is a two-person game in 
exactly this manner. 
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of the moves in his information set. If X is a chance move, then an 
alternative is chosen in accordance with the probabilities specified by 
(III) for the information set containing X. In this manner, a path with 
initial point 0 is constructed. It is unicursal and, since K is finite, 
leads to a unique play W. At this point, player i is paid the amount 
h^(W) for i « 1, ..., n. The case in which K reduces to the vertex o 
is not excluded. Then P is a no-move game, no one does anything, and the 
payoff is h(o). 

The price of the intuition gained with the use of a geometric 
model is the introduction of a certain amount of redundancy. Suppose 
and P 2 are two games defined with game trees K 1 and K 2 such that: 

(1) K 1 and K 2 are homeomorphlc. 

(2) The homeomorphlc mapping r of K 1 onto K 2 preserves 
the distinguished vertex and the specifications (I) - (IV). 

(3) On each information set, effects a permutation of the 

indices of the alternatives. (To make this more precise, (3) requires the 
existence of a permutation of the integers 1, ..., j for each infor¬ 

mation set U C Aj such that, if T> 1 and v 2 denote the functions index¬ 
ing the alternatives in K 1 and K 2 , V 2 (<r(e)) =T u (v l (e)) for all 
alternatives e at moves in U.) It is clear that in such a case the 
games P 1 and P 2 should be considered equivalent and that a proper 
definition would define a general n-person game as an equivalence class 
under this equivalence relation. However, this distinction need not be 
emphasized; if care is taken to frame definitions which apply to the 
equivalence class as well as to the representative, one can ignore it 
entirely in proofs and remark that all of the theorems hold for either 
class or representative. 

Although the majority of the above formalization needs no justi¬ 
fication, ample motivation appearing in the book of von Neumann and 
Morgenstern, several features deserve comment. The first concerns the 
finiteness of the game tree. Since the rules of most games Include a Stop 
Rule which only Insures that every play terminates after a finite number of 
choices it is not completely obvious that this entails that the game tree 
be finite. To demonstrate this, following Konig,^ we will assume that 
there are an infinite number of possible plays and then contradict the Stop 
Rule by constructing a unicursal path starting at 0 and containing an 
infinite number of edges. Since the choice at o Is made from a finite 
set of alternatives, there must be an infinite number of plays with the 
same first edge e^. We proceed by induction; assume that edges 
©j, ..., e-j. have been chosen such that is the beginning segment 


^Konig, D*, Uber eine Schlussweise aus dem Endlichen ins Unendliche, Acta 
Szeged 1 (1927), pp. 121 - 130 . 
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of an infinite number of plays. Then, since the next choice is made from a 
finite set, an infinite subset of these plays must continue with the same 
edge, say e 1+1 . This completes the proof. 

A more crucial question is that of formalizing the state of 
information of a player at the occasion of a decision, i.e., at a move. If 
one examines the information given to a player by von Neumann's "patterns 
of information" it is found to consist of several parts. First of all, he 

is told that it is his move and is told the number of alternatives. In our 

terminology, this says that the move lies in P i /I Aj for some fixed i 
and j. Secondly, he is told that the move lies on one of a certain set of 

plays and has been preceded by a fixed number of choices. From this he can 

deduce that his move lies in a set of moves which all have the same rank. 

It is this set of moves which forms a U in the information partition; 
however, we have weakened the requirement that all moves in U have the 
same rank to the condition that no U contains two moves on the same 
play.] 

$ 2 . COMPARISON WITH THE FORMULATION OF VON NEUMANN 

[The object of this section is to clarify the relation between 
our "general n-person game" and a "von Neumann n-person game." Incidental¬ 
ly, it will be shown that the formulation given above is more general than 
von Neumann's but this is of minor importance beside the major purpose of 
throwing light on the points of agreement. The best way to do this seems 
to be to describe the method of transition from one extensive description 
to the other. Accordingly, we commence by deriving a "general n-person 
game" from a "von Neumann n-person game." 

Take as vertices of K the non-void subsets A R of the parti¬ 
tions & K , K = 1, ..., V + 1. A vertex A K is joined to a vertex A K+1 

by an edge if A R+1 « A R n C R for some C R . Remark that A R has j 

alternatives if it is contained in a D which contains j sets C„ and 
that the moves on K are the vertices A R , K = 1, ..., v, while the plays 
are the vertices A y+1 . The player partition of the moves is defined by 
P k * C 3 ° me B k for> lc = °> •••> n * The information parti¬ 

tion of the moves is defined by U = (A |A C D ) with one U defined for 

K K K 

each D R G lr K (k), K - 1, ..., V and k ■ 1, ..., n; the chance moves 
A r C B r ( 0) form one-element sets in the information partition. For each 
U C P^ n Ai, that is, for each A w C B (o), where A w contains j sets 

o J l\ l\ »\ 

C K of <? R (o), the probability assigned to the alternative corresponding 

to A„ h is p (C ) . Finally, the functions h v are defined on the 
In n K K K 


8 For the comparison, the notation of von Neumann, loc. cit., pp. 75-75, Is 
followed. 
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plays by h^A^) "" ^Ay+I ^ for a11 Plays A y+1 and k - 1, ..., n. 

The imbedding has been left to the last, as it may be, since it 
is independent of the other specifications. Imbed 0 arbitrarily. 

Suppose the imbedding has progressed as far as the moves A K > We imbed the 
alternatives at all of the A K of a fixed U in the same order in the 
orientation. This is possible since each of these has the same number of 
alternatives (the number of C^ contained in the fixed set which 
defines U). 

There are two restrictive conditions which are fulfilled on the 
general n-person game thus obtained. 

(A) All plays contain the same number of moves v. 

(B) All moves In a fixed information set U (defined by D K ) 
have the same rank (k)• 

Condition (A) is trivial and can be fulfilled in all of our games 
by filling out short plays with "dummy" chance moves with one alternative. 
Condition (B) is not trivial and will be discussed after the derivation of 
a "von Neumann n-person game" from a "general n-person game" which 
satisfies conditions (A) and (B) . 


(10:A:a) 
(10 :A:b) 
(10:A:c) 

(10:A:d) 


(10:A:e) 


(10: As f) 


(10:A:g) 


(lO:A:h) 


The number v is the number given by condition (A) . 

The finite set TL is the set of plays in K. 

For every i - 1, ..., n: The function 9^(W) ** h^W) 
for W G Si. 

For every r * 1, ..., v: The partition & p in it 
contains one set A p for each move X of rank r which is 
defined by A p « (W|W > X). The partition CL, j consists of 
the one-element sets (W). 

For every r - 1, ..., V: The partition # p in IV 
contains one set B p (I) for each i - 0, i, ..., n which Is 
defined by B p (i) - (W|W > X where X is of rank r and 
X £ P 1 ). 

For every r - 1, ..., V and every i « 0, 1, n: 

The partition C p (i) in B p (i) contains one set C p for each 
alternative e at an information set U C P^ which Is of 
rank r. It Is defined by C p - (W|W follows some X £ U by 
the alternative e). 

For every r - 1, ..., v and every 1 « 1, ..., n: The 
partition # p (I) in B p (i) contains one set D p for each 
U C which contains only moves of rank r. It is defined 
’by D p - (V| V >X6U). 

For every r « 1, ..., V and every C p Q C p (o): The 
number p p (C p ) is the probability assigned to the alternative 
e by specification (III). 
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The proofs that the games thus derived actually satisfy the 

requirements placed on them (that is, by Definitions 1 and 2 in the first 

case and by (10:1:a) - (10:1:j) in the second) are omitted. If they are 

not always immediate, they are all straight-forward and easily obtained. 

The important question is: What happens if we derive a general n-person 

game from a von Neumann game again? The answer is quite obvious from the 

above, namely, the set XI has been reduced to include only those plays 

which are allowed by the rules of the game. More precisely, XL has been 

reduced so that (1) all partitions of a set are such that the union of the 

elements of the partition is exactly the set and (2) plays it g C k G £ k (0) 

such that p (C ) * 0 have been dropped. The discussion may be summarized 
K K 
by: 

THEOREM OF CATEGORIZATION: The von Neumann games, 
excluding Illegal or impossible plays, are the general 
n-person games In which a player's information at the 
occasion of a decision Includes the number of choices 
preceding that decision. 

g 

The following diagram concludes this section with an example^ of 
a general n-person game In which a player is not informed of the number of 
choices preceding his move. The dotted lines enclose information sets.] 



$ 3 • PURE AND MIXED STRATEGIES 

DEFINITION 3. Let U ± = (U|U C P ± ). A pure 
strategy for player i is a function ir^ mapping 


9 This example, as well as substantial contributions to the interpretations 
was communicated by L. S. Shapley and J. C. C. McKinsey. 





200 


KXJHN 


into the positive integers such that U C Aj 
implies ir^U) < j. We will say that chooses 

the alternative e incident at X £ U If 

* ± <U) * ■ 

[The interpretation of a pure strategy is that it is a plan 
formulated before a play by a strategist for player i who then communi¬ 
cates his choices to the agents of player 1. One may do this without 
violating the rules of the game regarding the information possessed by the 
agents by imagining that the strategist writes a book with one page for 
each of player i's Information sets. If an information set has j 
alternatives, its page will contain a positive integer not greater than j 
and is given to the agent who is acting on that information set for player 
i. If his information set appears in a play then he Is to choose the 
alternative Indexed by the integer. This interpretation motivates the 
following definitions.] 

Any n-tuple It = (ir , ..., ir n ) of pure strategies for the n 
players defines a probability distribution on the alternatives in each of 
the information sets of K as follows: 

If e is an alternative at a personal move for player i in 

f 1 If *,(U) = v(e) 

the information set U: p (e) 

™ I o otherwise. 

If e Is an alternative at a chance move: p_„(e) Is the 

it 

probability assigned to V(e) by (III). This, In turn, defines a 
probability distribution on the plays of K by: p^W) = TT^y P^Ce) 
for all W. 

[The interpretation is Immediate; if the n strategists choose 
the pure strategies , ..., ir n , then the probability that the play W 
will result is p^W) .} 

DEFINITION 4. The expected payoff H^it) to 
player i for pure strategies Itj, ..., ir n is defined 
by H^ic) - 2 W P^(W)h i (W) for 1 - 1, ..., n. 

[Again redundancy is the price of a facile definition of pure 
strategies. Its nature is made clear once It is remarked that a pure 
strategy may make a choice at an early part of a game that makes many later 
moves impossible and hence renders the choices on those moves irrelevant. 
However, it can be viewed in another manner, namely, the efficacy of a 
strategy is to be measured by the payoff and hence two strategies 

should be considered equivalent if they produce the same payoff against all 
counter-strategies employed by the other players. Leaving the payoff 
function h arbitrary for the moment, this can be restated: two strategies 
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should be considered equivalent if they yield the same probability for 
every play against all counter-strategies emplpyed by the other players. 
The rest of this section shows that these two views of the redundancy are 
the same and revises the definition of pure strategy accordingly.] 

If ir =s (iTj, ..., ir 1# ..., ir n ) we shall write ir/ir| for 
(ir^ f ..., it£, • • •» • 

DEFINITION 5* The pure strategies IT^ and Itj 
- are equivalent , written = 1C£, if and only if 
P^W) = Pit/rc|( w ) for a11 Plays w ^ all tr con¬ 
taining it^. 

DEFINITION 6. A personal move X for player . i 
is called possible when playing if there exists a 

play W and ir containing such that p^CW) > 0 

and X £ W- An information set U for player 1 is 
called relevant when playing if some X t U is 

possible when playing 'Tt^. We will denote the set of 
moves which are possible when playing by Poss ir^ 

and the family of information sets which are relevant 
when playing by Rel . 


PROPOSITION 1. A move X for player i is 
possible when playing if and only if IT^ chooses 

all alternatives on the path W x from 0 to X which 
are incident at moves of player i. 


PROOF- Let X be possible when playing It then there exists 
a play W containing X and tt containing such that p (W) - 

7T e £w Pir^ ^ °* Hence it is clear that ir^ chooses all of the alterna¬ 
tives for player i on W, thus certainly those of player i on W x - 
Now assume chooses all the alternatives for player i on 

W x - To demonstrate the possibility of X it Is necessary to construct a 
play and strategies for the remaining players. Since no information set 
contains two moves on the same play, in constructing the strategies, 
choices on a unicursal path may be assigned independently. The choices 
for personal moves on W x are assigned so as to conform to W x - At X 
the choice Is made by the construction of a play is continued by 

making choices arbitrarily except when they are specified by TC^. Call the 
resulting play W. The unspecified choices are made arbitrarily and the 
resulting pure strategies are called iTj, ..., *1-1* 1t i+ ,, ir n< Then, 
since the probabilities of chance alternatives are positive, 
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PiC (W) > o and X is possible when playing it^. * 

COROLLARY. Let the information set U contain 
the first move X for player i on a play W. Then 
U is relevant for all pure strategies 1 C^ for 
player i. 

THEOREM 1 . The pure strategies ir^ and are 
equivalent if and only if they define the same relevant 
information sets and coincide on these sets. 

PROOF. Suppose it^ ~ TT| and U is relevant when playing fa. 
Then there exists a move X Q U, a play W, and it containing IC^ such 
that: 

pjw) >0 and X G W . 

It 

Hence P 1 0 t .(W) * P<It (W) > 0 , and U is relevant for fa. Moreover, by the 
definition 1 of p(W), U^U) - 1 t|(U) » V(e) where e is the alternative 
at X which lies on W and thus IC^ and ir| coincide on U. 

To show that the condition is sufficient, assume that a play W 
and It containing itj, are given. If Plr (W) *= TT^ W Plr (e) > 0 then 
1^(XJ) = v(e) for all alternatives e lying on W and incident at personal 
moves of player i in U. All of these moves are possible when playing 
fa and hence the same conclusion holds for 1C|. But then 

^eGW p ir/it^ (e) " "^e£W p ir (e) ' 

But, interchanging 1 and fa in this argument, p^W) = 0 implies 
Plc (W) « o. Consequently, ^ s ir|. 

[The interpretation of a pure strategy as a strategy book can be 
extended to the equivalence classes defined above by leaving blank those 
pages which correspond to irrelevant information sets.-} 

[Even the simplest games, e.g. Matching Pennies,'reveal that a 
player is at a disadvantage if he uses the same pure strategy in each play. 
Instead he should randomize his choices. Two methods of randomization are 
described in this paper. In the first, the player uses a probability 
distribution on his pure strategies, choosing the particular pure strategy 
that he will employ in a given play of the game according to this distribu¬ 
tion. Following von Neumann, it is called a mixed strategy. The second 
method is studied in Section 5«] 

EEFINITION 7* A mixed strategy for player i, fa. 
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is a probability distribution on the pure strategies 
for player i, which assigns probability q^ to 

Any n-tuple p « , ..., ^ n ) of mixed 1 strate¬ 

gies for the n players defines a probability distribu¬ 
tion on the plays of K by: 

p^(W) - S^q^ ••• q^ for all W . 

DEFINITION 8. The expected payoff to 

player i for mixed strategies fi ^, • • • > is 
defined by p^CVOh^W) for i - 1, ..., n. 

PROPOSITION 2. For each move X, let c(X) be 
the product of the chance probabilities at alternatives 
on W^, the path from 0 to X. Then 

p m (x) = c(x) X % ••• % - own - .., ( X q- ) 

^ XGPossTTj, ~n 1 1 v XGPossir^ jL ' 

1=1....,n 

gives the probability that the move X will occur when 
the players play [l. 

PROOF. This is an immediate consequence of Proposition 1 and 
the Interpretation of a mixed strategy. 

DEFINITION 9 • A personal move X for player I 
Is called possible when playing if there exists an 

n-tuple fJL of mixed strategies containing ^ such 
that p^(X) >o. An Information set U for player i 
is called relevant when playing if some X G U is 

possible when playing Again, we shall write 

Poss ^ and Rel for the sets of X and U which 
are possible and relevant when playing fi 

THE DECOMPOSITION OP GAMES 

[It often occurs that the moves of a game which are subsequent to 
a fixed move X form a subgame in a natural manner. They constitute the 
vertices of a game tree with X as first move while the player partition, 
the probabilities at the chance moves, and the payoff on the plays in this 
tree carry over from the original game. This is also true of the informa¬ 
tion partition if, at every move of the original game, the player choosing 
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is informed whether or not his move is in the subgame. 

If this happens, the moves which do not lie in the subgame also 
form the moves of a game which is determined up to the payoff at the 
vertex X (which is a play in this game’.). In this section, this de¬ 
composition of a game into a pair of games will be studied to show that 
the equilibrium points of the pair determine the equilibrium points of the 
original game.] 


DEFINITION 10 . Given a move X in a game P, 
let Kj£ be the component of K which contains X if 
we delete the unique edge (if any) at X which is not 
an alternative at X. We shall say that P decomposes 
at X into r x and P^CP^ every information set 
U either is contained In K x or does not intersect 
Ky. The game P x is called the subgame and is defined 
as follows: 

The game tree is K x ; as such It is imbedded in 
the same oriented plane as K and has X as distin¬ 
guished vertex. 

(I x ) (H x ) The player and information partitions 
of the moves of P x are the respective partitions of 
the moves of K restricted to K^- The family of in¬ 
formation sets for player 1 will be denoted by 3^. 

(III X ) For each chance move in P x the proba¬ 
bility distribution is that specified by (III) In P. 

(IV X ) The payoff function for P x Is the 

payoff function h restricted to the plays of K x - 

A game P D (p x ) > called a difference game , is 
defined for each n-tuple of mixed strategies , p x , in 
P x - Its game tree is K - K x completed by X and has 
o as its distinguished vertex. The specifications 
(I D ) - (IV-p) are made as above with the additional def¬ 
inition that h^X) - 
pendence of the payoff In Pj^f 4 ^ on f* x , we shall 
write this payoff as H D (/* D ,/* X ). The family of Infor¬ 
mation sets for player I will be denoted by 

[Corresponding to this natural decomposition of P into the 
subgame P x and the difference game Pp, there Is a natural decomposition 
of the pure strategies for P into pairs of pure strategies for P x and 
P D . The main burden of our proofs in this section lies in analyzing the 
effect on the payoff of this decomposition and the analagous splitting of 
mixed strategies for P.] 


H x (f* x ) * to emphasize the de- 
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DEFINITION 11. Let the game P decompose at X. 
Then we shall say that a pure strategy for player 
I decomposes at X into pure strategies and 

^Dli fop P la Y er 1 ln and 

(a) is the restriction of from 2^ 

to 3Sj, and 

(b) is the restriction of from 

to Since is the disjoint union of 5^ and 

we can also compose a pure strategy rc^ from pure 
strategies ir YJ . and 1T nl . which will be denoted by 

LEMMA 1. If ^ decomposes into ^li and 
*D| i for i =* 1, ..., n, then 

Pir (Y) " ^ b {Y) f0r a11 Y G * K D 


and 


P^Y) = p^Mp^tY) for all 

where it = (nr,, . • •, ir n ), ^ - f^xi 1' •••» lr x|n^’ ^ 

1t D = (lr D|1’ ’"bln 5, 

PROOF. The verification is immediate, using the definition of 
,(Y) and the fact that all paths from o to a Y in pass through 


DEFINITION 12. Let the game P decompose at X. 
Then we shall say that a mixed strategy for 

player i decomposes at X into mixed strategies 

^X|i anci /*D|i for P la Y er 1 ln 

(a) q_ = 2 q_ for all where 

T>|i D(« 1 )“ 1 *b|l *1 D|i 

D(ir^) denotes the restriction of TC^ from U i to 

(b) When X € Poss 

Q*ir “ Q*. for all X„i . , 

^li y XGPosslT^ ^i 

XGPossic^ / 

where XCnr^) denotes the restriction of 11^ from 
to % v 
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When X $ Foss j^, 

q~ *■ X q_ for all it TM . 

*XU X(it 1 )=fl^|i ***1 X|i 

LEMMA 2 . Every pair, ^ and of mixed 

strategies for player i in P x and P D is obtained 
from the decomposition of some ^ in P. 

PROOF. Let (^Dii^xii^ denote the pure strategy for P 
obtained by composing and ^xii* We then aet 

Q <Wx|i> ■ %i f ° r ^ ^ “* ^11 • 

Then (a) and (b) are easily verified once it is remarked that X G Poss 
if and only If X G Poss It should be noticed that our composition 

and decomposition of mixed strategies is a consistent extension of the 
original definitions for pure strategies. 

THEOREM 2. If P deconposes at X then there 
is a mapping of the n-tuples fi of mixed strategies 
for P onto the pairs of n-tuples of mixed 

strategies for P^ and T x in such a way that 

(1) H(f) = Hd^d'^X^ 

If corresponds to /a. under the mapping. 

PROOF. The mapping is the decomposition of Definition 10. 

Lemma 2 says that it is a mapping onto all pairs. To prove (1) we consider 
the members of the equation separately. First, 

(2) H(»0 - p(W)h(W) - X p (W)h(W) + X P (W)h(W) . 

r W /*■ W6K-Kj P WEKj ^ 

Second, 

(3) Hd^) - P /lD (W)h D (W) - P / ^(W)h D (W) ♦ P^XJH^) • 

noting that, if W 6 K - Kg, 
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V w) “ 1 ?\ ••• X p ^ (w) 

” ^ ( , ? q ir • ’ • Qir )Pir M 

= S q_ , ••• q_ , P*(W)=p (W) 

"Kp jD| 1 TD|n D rD 

and hence, comparing (2) and (3), we need only show 

(4) X p (W)h(V) = p (X)H x (f* x ) . 

W£Kj£ * » D 

However, since 

HyQO = s P„. (W)hy(W) = X P. (W)h(w) , 

A A WGKjj “X A WGKjj h C 
to prove (4) it is sufficient to show 

(5) Pp(V) = p^(X)p^(W) for all V € . 


(It should be remarked that this is the analogue of the second half of 
Lemma 2, stated for mixed strategies, and that our definition of the de¬ 
composition of mixed strategies has been framed intentionally to preserve 
this property.) 

Noting that 


- cam », ( x % ) - cuiTTi” (2a.) 

11 V XGPoss1C D|1 ^Dli 7 11 ' XGPossir^ Ti 9 


where c(X) is the product of the probabilities of chance alternatives on 
the path from 0 to X (the void product is taken to be unity) and 
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ve have 

P* (X)P M (W) - o(X)X ( , X q- ) ( P~ (V) 

XGPossit^ 

- %v n v w) 

-•■■%■>«<« - v 10 • 


This completes the proof. 

[The basic consequence of Theorem 2 is that solutions for P can 
be composed from solutions to P x and P^ if we take equilibrium points 
as our definition of a solution to an n-person game.] 

DEFINITION 13* An n-tuple JZ = (ji^ , ..., jZ n ) of 
mixed strategies for a game P is called an equilibrium 
point 10 if 


H i (/0 > for 1=1, ..., n 

for all where denotes the n-tuple of 

mixed strategies obtained by replacing by ^ 

in jji • 

THEOREM 3- Let P decompose at X, let jZ^ be 
an equilibrium point in the subgame P x , and let JZ^ 
be an equilibrium point in • If jZ is any 

n-tuple of mixed strategies for P which decomposes 
into jZ x and jZ^, then jZ is an equilibrium point 
for P. 


PROOF. Let /jl^ be any mixed strategy for player i 
decomposes into ^11 ^ f^li* en ^ ls clear 
into /^/jKxn and and 


which 

decoinposes 


10 See J. Nfetsh, "Non-cooperative games," Ann. of Math. (1951), 
pp. 286-295* 
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Ha (ft) - H d)1 (^ d ,/* x ) > Hoi i'A^x) 

“ vJLx VfD|i (W)hD ' l(W) + P V/ , D|i (X) ^l 1< ^ ) 

^WgIkx P / a D^D|i (W)hD ' l(W) + P V/‘D|i (X)Hx l i(Fx//lx l l) 

= H Dii ( ^r// t D|i'Fx//‘xii ) “ • 

[The computational consequences of Theorem 3 are clear; it is 
generally easier to solve two small games than one large game. We present 
two applications which derive directly or indirectly from this remark.] 

(A) THE THEOREM OP ZERMELO - VON NEUMANN. It is well-known that 
a zero-sum two-person game with perfect information always has a saddle- 
point in pure strategies. 11 In our formalization, a game with perfect 
information is one In which all information sets are one element sets and a 
saddle-point Is the zero-sura two-person specialization of the concept of an 
equilibrium point. 

COROLLARY 1. A general n-person game P with 
perfect information always has an equilibrium point in 
pure strategies. 

PROOF. The proof is an Induction on the number of moves in P. 

For a game with no moves it Is trivially true. For a game with one move It 
is immediate, since if that move is a personal move of player I then he 
should choose the alternative that maximizes his payoff, while if that move 
is a chance move then the theorem is again vacuously satisfied. For a game 
with m moves, since it assumed to have perfect information, it can be 
decomposed into two games with less than m moves. By the induction 
hypothesis, these have pure strategy equilibrium points whose composition 
is again a pure strategy and, by Theorem 3, an equilibrium point for P. 

(B) SIMULTANEOUS GAMES. A class of games, introduced by 

G. Thompson as a natural extension of games with perfect information and 
called simultaneous games , can easily be solved through the use of Theorem 3. 
These are zero-sum two-person games which may be described verbally as 
consisting of a sequence of simultaneous moves by the two players; following 
each such move both are informed of the choices. Since our formal system 
does not handle simultaneous moves (even Matching Pennies has two successive 


n E. Zermelo, fiber eine Anwendung der Mengenlehre auf die Theorie des 
Schachspiels, Proc. Fifth Int. Cong. Math., Cambridge (1912), Vol. II, p. 501 
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moves) ve must describe the games as follows: Player 1 has a 2 k-l 
alternatives at the moves of rank 2k - 1 and Player 2 has a 2k alterna¬ 
tives at the moves of rank 2k where k ~ 1, ..., K. Player 1 has perfect 
information at all of his moves, while Player 2 is informed at his moves of 
rank 2k of everything except the choices by Player 1 at the moves of rank 
2k - T. Clearly we can decompose a simultaneous game at any move of 
Player 1. 


i 5• BEHAVIOR STRATEGIES 

[In this section, another natural method of randomization is 
investigated. Using this method, a player chooses a probability distribu¬ 
tion on the alternatives in each of his information sets, thus randomizing 
on the occasion of a choice as he knows It. It is explicitly assumed that 
the choices of alternatives at different information sets are made inde¬ 
pendently. Thus it might be reasonable to call them "uncorrelated" or 
"locally randomized" strategies; however, since these are the distributions 
that one would measure in attempting to observe the behavior of a player, 
we have called them behavior strategies .] 

DEFINITION H. To each UC^ such that 
U C Aj, a behavior strategy for player i, 
assigns j non-negative numbers b(U,v), V « 

1, ..., j, such that 2b(U,v) * 1. 

Any n-tuple 0 = (^, ..., fi n ) of behavior 
strategies for the n players defines a probability 
distribution on the plays of K as follows: 

If e is an alternative at a personal move 
then p^(e) - b(U,v(e)). 

If e is an alternative at a chance move then 
p^(e) is the probability assigned to v(©) by (III). 

Finally, p^(W) - TT^y P^(e). 

DEFINITION 15- The expected payoff ^(0) to 
player i for behavior strategies » •••> fi n is 
defined by ^(0) - Sy P^W^tW) for i - 1, ..., n. 

[From our interpretation of behavior strategies, it is clear that 
each mixed strategy determines a behavior strategy. The next definition 
establishes this correspondence and the lemma following shows that we can 
achieve every behavior by some mixed strategy.] 


DEFINITION 16 . The behavior ^ of a mixed 
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strategy - (q^ ) for player 1 Is a behavior 
strategy defined * by: 

If U 6 Rel fLy then 


b(U,v) 


X 


U6Rellt^ 





If U( Rel f4. ± then 


b(U,V) « 2, q 


LEMMA 3- Given a "behavior* strategy for 

player i, define a mixed strategy fx^ « (q^ ) for 
player i by: 1 

(6) Sti = b(U > lr i (U)) • 

Then is the behavior of ^. 

PROOF- This lemma is a direct consequence of Definition 16 

and (6). 

[To apply these notions to a concrete example, consider the 
following game: 


A PARTNER GAME. In this zero-sum, two-person 
game, player 1 consists of two agents, called the 
Dealer and Partner, respectively. Two cards, one 
marked "High," the other "Low," are dealt to the 
Dealer and player 2 — the two possible deals occuring 
with equal probabilities. The agent with the High 
card then receives one dollar from the agent with the 
Low card and has the alternatives of terminating or 
continuing the play. If the play continues, the 
Partner, not knowing the nature of the deal, can 
instruct the Dealer to change cards with player 2 or 
to hold his card. Again, the holder of the High card 
receives a dollar from the holder of the Low card. 

In our formalization, this game is described by the following 
diagram (remark that the possible plays are labeled with the payoff to 
player 1). 
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% - iu 0 ), a, = \ = tu 2 ) . 

For simplicity's sake, we will denote the pure strategies IT, 
for player 1 by (^'(U,) .it, (Uj)) and the pure strategies ir 2 for player 2 
by (ir 2 (U 2 )). Then the game matrix of expectations H, (TT, ,ir 2 ) is: 

( 1 , 1 ) 

( 1 , 2 ) 

( 2 , 1 ) 

( 2 , 2 ) 

and the "solution" q (1>l) - q (2>2) = 0 , q (1>2) - q (2>1) = i . and 
q< 1 ) ** Q( 2 ) = \ insures player 1 the expectation ^ while player 2 can 
expect to lose no more than On the other hand, if we let x = b(Uj,l)> 
1 - x » b(U 1f 2) and y » b(Uj,l), 1 - y - b(U^,2) be the behavior strate¬ 
gies for player l, we have: 

r (0 

Player ] ' s expectation against 1C 2 «- is 

(2) 



(D (2) 



Hence the maximum amount that player 1 can assure himself is 
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max min C-4 + 4 x + y - xy, 1 x - xy) » 0 . 

<*x*1 

°sy*i 

Thus, behavior strategies may do a poorer job than mixed strategies. Re¬ 
mark that the mixed strategy p, = (q (i,i)' q (i,2) ,q (2,i) ,q (2,2) 5 ^ as 

its behavior /5 1 = (x,y) - (q (ljl) + <*( i , 2 y ,q ( i, i) + Q( 2>1 ))- Hence, if we 

consider the optimal mixed strategy (o,^,t>,o) for player 1, the associated 
behavior is x = y = j and, while the optimal mixed strategy assures 1 the 
amount ^ , even its associated behavior only assures 1 the amount o. 

This discrepancy is due, of course, to the uncorrelated nature of the 
behavior strategy. To obtain positive results on the use of behavior 
strategies we must restrict the nature of the information partition. 

DEFINITION IT- A game P Is said to have perfect 
recall if U G Rel 7^ and X G U implies X G Poss 

for all U, X aiic ir . 

j. 

[The reader should verify that this condition is equivalent to 
the assertion that each player is allowed by the rules of the game to 
remember everything he knew at previous moves and all of his choices at 
those moves. This obviates the use of agents; indeed the only games which 
do not have perfect recall are those, such as Bridge, which include the 
description of the agents in their verbal rules.] 

LEMMA 4. Let P be a game with perfect recall 
for i = 1, .n. If I has a move on W, let the 
last alternative e for 1 on W be incident at 
X G U and set T ± (W) = (ItjJ U G Rel and 
tC ± (U) « V(e)); otherwise, T ± (W) Is the set of all 
IT^. Finally, let c(W) be the product of the proba¬ 
bilities of the chance alternatives on W or 1 if 
there are none. Then, for all IT and all W, 

r c(W) if ir ± G T ± (W) for i - 1, n . 

V w) 1 

[_ o otherwise . 

PROOF. It is clear that we need only show that ir^ G T^(W) 
implies that chooses all of the alternatives for i on W (if any 

such exist) . But ir^ G T^W) implies U G Rel and hence, since P 
has perfect recall, X G Poss ir^. Therefore, by Proposition 1, chooses 

all of the alternatives for i on W. 
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LEMMA. 5» Let e be an alternative on a play V 
Incident at X G U G and let the next move for 
player 1, If any, be Y G V. Further, let 

S - (irj U G Rel 1C ± and ir ± (U) - V(e)} 


and 


T - C-nr ± | v G Rel 1 ^} . 


Then S = T. 

PROOF. Let ^ G 3. Then U G Rel and hence, since f 1 has 
perfect recall, X G Poss It^ and therefore, by Proposition 1, chooses 

all alternatives for i on the path 0 to X. But it^dJ) - v(e) and 
hence 1 It^ chooses all alternatives for i on the path 0 to Y. There¬ 
fore Y G Poss It^, V G Rel IT^, and G T. 

Let G T. Then V G Rel and hence, since P has perfect 
recall, Y G Poss and therefore X G Poss IT^ and IT^dJ) = V(e) . That 

is, HT^ G S and the lemma is proved. 

THEOREM 4. Let p be the behavior associated 
with an arbitrary n-tuple of mixed strategies ^ in a 
game P (in which all moves possess at least two 
alternatives). Then a necessary and sufficient condi¬ 
tion that 

H i<p) - H ± (jjl) for i - 1, ..., n 

and all ft and for all assignments of the payoff func¬ 
tion h is that P have perfect recall. 

PROOF. Assume that P has perfect recall; then we need only 

show 

V W) " p /a. (W) for a11 W • 

If there is an alternative e on W belonging to player i which is 
incident at a move in an irrelevant information set for then both 
sides are clearly zero. Hence we may assume that all such information sets 
are relevant for Working with each side separately, first: 
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Considering those alternatives e on W which belong to i, their proba¬ 
bilities are given by the fractions of Definition 16 . The first denominator 
is clearly 1 while each numerator is the denominator of the next fraction 
by Lemma 5 • Hence 

p (W) = c(W)7Ti=i ( 2) <*tr ) 

P " 1 1 ' ir^T^v) 1 ' 

where c(W) and the T^W) are defined as in Lemma 4. On the other hand, 

y w) “?%••• x p * (w) 

= S q TT • • • c w) 

allir i GT i (W) ^1 

by Lemma 4. Comparing the two expressions for p(W), it is seen that the 
sufficiency is proved. 

For the necessity, if P does not have perfect recall then there 
must be a pure strategy ir^ and two moves X and Y in an information 
set U with X £ Poss fa and Y $ Poss fa. Choose a for which Y 

is shown to lie in Poss tc* by the play W and the n-tuple it*. If one 

ii 1 

sets fa = ^ ^ + g 1 * 1 * then 

P ic/fr™ = 5 ° (W) • 

However, there is an alternative e lying on the path from 0 to Y 
which is chosen by fa but not by ir^ and thus is assigned probability ^ 
by the behavior of fa. If we assume 1T|(U) ^1^(11) then the behavior of 
fa assigns the probability ^ to the alternative at Y on W. Hence 

P^V) < I c(W) 

and the proof is completed. 

EXAMPLES. To illustrate the efficacy of behavior strategies, it 

is possible to draw three examples from the literature. It is mere 

coincidence that they are all variants of Poker; the essential common 

property is that they all have perfect recall. 

EXAMPLE 1. von Neumann and Morgenstern give a Poker example 12 in 

s 

which the number of pure strategies for each player is 5 , S being the 
number of possible "hands.” Hence the dimension of the set of mixed 

12 Loc . cit ., pp. 1 ^ 0 - 196 . 
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strategies is 3 - 1. However, the dimension of the set of behavior 
strategies is 2S; when S is a large number the difference is con¬ 
siderable . 

i 5 

EXAMPLE 2. In the example given by the author, domination 
arguments reduce the number of pure strategies from 27 to 8 for player 1 
and from 6k to k for player 2 . Nevertheless, the computation of solutions 
is still a tedious matter. With behavior strategies the payoff function has 
3 variables for player 1 and 2 variables for player 2; moreover it has no 
terms of degree higher than 2 and so the computation of solutions is a mere 
exercise in elementary calculus. 

EXAMPLE 3» In the Simple 3-Person Poker of Nash and Shapley, 1 ^ 
domination arguments result in a game in which the three players have, 
respectively, 17, 19, and 31 dimensions of mixed strategies. However, they 
each have 5 dimensions of behavior strategies and this reduction makes 
possible the discovery of the unique equilibrium point for their game. 


H. W. Kuhn 


Princeton University 


^Euhn, H-, \ simplified two-person Poker, - Annals of Math. Study 2U (1950), 
pp. 97-103. 

lj|, N&sh, J. and Shapley, L. S., "A simple three-person poker game," Annals 
of Math. Study Pk ( 1950 ), pp. 105 - 116 . 



EQUIVALENCE OP INFORMATION PATTERNS 
AND ESSENTIALLY DETERMINATE GAMES 1 

Norman Dalkey 
INTRODUCTION 

In the first sections (1-5) we examine the equivalence of games 

p 

in extensive form, using the model proposed by Kuhn. There are several 
kinds of equivalence that might be explored, depending in part on what one 
considers reasonable methods of play. We are concerned with equivalence 
with respect to mixed strategies. A quite different notion of equivalence 
would be needed, for example, if the play were limited to behavior strate¬ 
gies . 2 

The notion of equivalence we evolve is only distantly related to 
the idea of strategic equivalence introduced by von Neumann and Morgenstern 
([51, PP- 2 U 5 - 248). They are concerned mainly with variations in the 
payoff function which leave a solution invariant; we shall be concerned with 
variations in the structure of a game in extensive form which leave the 
major strategic properties of the game invariant irrespective of the pay¬ 
off function , 5 

A complete treatment of equivalence under variations in the 
structure of a game in extensive form is not given, but only equivalence 
under variations in the pattern of information. Roughly speaking two In¬ 
formation patterns for the same player are equivalent If they differ at a 
given position in the game only in the knowledge which that player has of 
his own previous moves. 

In the later sections, these results are applied to furnish a 
necessary and sufficient condition for a general game to have an equilibrium 
point in pure strategies independently of the particular pay-off function 


^The preparation of this paper was supported by The RAND Corporation. 

2 cf. Kuhn [ 2 ]. 

^The mode of approach la quite similar to that of Krental, Quine, McKinaey 
[ 1 ], and our results may be considered as an extension to general games of 
their results for two-person, zero-sum games. 
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or of the particular probability distributions assigned to chance moves. 

We call such games essentially determinate , since the question whether or 
not they will have an equilibrium point in pure strategies is completely 
determined by the information pattern alone. 

The condition, which we have labelled effectively perfect infor ¬ 
mation , is that at any move a player know all preceding moves of his 
opponents, and know at least as much as his opponents knew when they made 
those moves. In the special case that there are no chance moves, this 
condition is simply that the game be equivalent with respect to information 
to a game of perfect information , ** 

j 2 . GAMES IN EXTENSIVE FORM 

We shall follow rather closely the definition of games in ex¬ 
tensive form given by Kuhn, with some minor notational modifications. 

DEFINITION 1. A general n-person game P in ex¬ 
tensive form is defined by 

(PI) A game tree , K, which is an ordered set of 
positions (x, y, z ...). 

(P2) An information pattern U - i^ Q , U y , ... U^} 
where each = (U, V, ...) partitions a 
subset of K. 

(P3) An n-component, real vector function h = 

(hj(w), h 2 (w), ..., h n (w)) defined on a 
designated subset W of K. 

(P4) A set function p(V,U), defined on U G 
1, 2, .... m(U), 0 < p(V,U) < 1 . 

When we wish to indicate the dependency of P on these 
entities, we shall write 

r - P(K/u,h,p) . 

Rather than axiomatize this set of primitives, we shall follow 
Kuhn in giving them a geometrical interpretation. 

K is a finite tree, embedded in an oriented Euclidean plane, with 


I* 

von Neumann and Morgenstern first proved that perfect information is a 
sufficient condition for a two-person zero-sum game to have a saddlepoint 
in pure strategies (see [4], Sec. 15)* Kuhn extended this result to equi¬ 
librium points in pure strategics for general games. / Shapley [ 5 ] gave a 
necessary and sufficient condition for a saddlepoint in pure strategies for 
a restricted class of two-person zero-sum games which is similar to the 
condition for general games we give below. 
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a distinguished vertex 0. The set W of end points of K are called 
plays , the remaining vertices moves . (We shall sometimes call both plays 
and moves by the common name positions .) The unique unicursal path leading 
from o to a play v will also be called a play, and represented by w. 

The m positions immediately succeeding a position x are 
indexed by positive integers v = 1 , 2 , m where m depends on x. 

x v will designate the v'th position immediately following x. m(x) 
designates the total number of possible choices (alternatives) at x. The 
rank of x in K, i.e., the number of positions which preceed x, will 
be designated by r(x) . D(x) (descendants of x) will represent the set 
of all positions that follow x, and D(V,x) the set which follow by the 
y'th alternative. 

The information pattern U first partitions the moves of K 
into n+1 exclusive subsets, and then further subdivides each of these 


subsets into information sets , u = are those positions where 

player i "has the move.” P = (P Q , P^, ...» P n ) is called 

the player partition . At each x £ U £ player i is informed that he 

is at one of the positions in TJ. For each Information set U, the number 
of alternatives is the same for all positions in U, hence we can write 
m(U), the total number of alternatives available at any position in U. 
Information sets are further restricted by the rule that no information set 
intersects the same play more than once. 

The set ^ is reserved for the "chance player," i.e., every 
x G P Q is a chance move. We allow U £ to contain more than one move; 
this furnishes a convenient way of identifying the probability distributions 
at different chance moves. 

p(v,U) is assigned so that for U ( p(v,U) = 1 for every y. 


is assigned so that for U ( ; 

For U £ 7^, 0 < p(V,U) < 1 , X v=i^ p(V»U) “ 1 • Hence for chance moves, 
p(y,U) assigns a probability distribution over the m possibilities. We 
set p(y,x) = p(v,U), xCU. 

h is the pay-off function. To each play w it assigns an 
n-tuple of real numbers determining how much each player is to receive at 
that point. 

We shall call a pair (K,U) a game structure , and corresponding¬ 
ly (K ,U) will be called the structure of P(K,U,h,p). u ^ will be called 
the information pattern for player i. 


DEFINITION 2. A pure strategy for player i is a 
function 7r ± (U) which maps each U £ ^ onto a posi¬ 
tive integer V < m(U). (We shall sometimes also use 
to denote pure strategies). We define the 
choice at a position x of a strategy as ^(x) « 
^ (U) where x £ U. 
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It is clear that a game structure (K, 3 $ com¬ 
pletely determines the set of all possible pure strate¬ 
gies (as well as mixed and behavior strategies) for each 
personal player. 

Note that our definition specifies strategies for 
the chance player as well as for the personal players. 

A chance strategy corresponds to von Neumann and 
Morgenstern's "umpire’s choice." ([ k ] , p. 81). 

Let ir* = (ir Q , ir , ir 2 , ..., ir n ) designate an 
n+T-tuple of strategies, one for each player, and ir « 

(ir , ir 2 , ..., ir n ) an n-tuple of strategies, one for 
each personal player. It is clear that each TT de¬ 
termines a unique play w, which we will designate by 
w(ir*). Let ir*(U) = TT, (U) where U G U. and ir. is 
contained in fr . We define w(tr ) recursively. 

DEFINITION 3 • w(ir*) is the set of positions such 

that 

1 . 0 £ w(it* ) 

2 . x £ w(ir*) implies x v £ w(tr*) where ir*(x) » V 
w(ir*) is the final member of w(ir*) . In case 
x £ w(ir*), -rr* is said to realize x. More generally, 
if V is an m-tuple of strategies m < n+1, It is said 
to realize x if there is some it* containing ir and 
x £ w(ir*). 

An immediate consequence of Definition 3 is 

LEMMA 1 . w (ir*) = w(/®*) if and only if for every 
x £ w (ir*), rr*(x) = p*{x), or, equivalently, if and 
only if for every U that intersects w(ir*), ir*(U) = 

P*(U). 

Let rr*//o^ designate the n-tuple which results when P^ is 
substituted for in ir*; i.e., if it* « (rr Q , ir^, ..., ..., ir n ) 

then **/>! " ^ , ..., P v ..., ir n ). 

THEOREM 1. u(ir*/p±) * implies 

v(ir*) - w(tr*/^i) - v(ir*Aj) - v(iry/* ± /Tj) 

PROOF. If no U € intersects wftr*/^)# then by Definition 3 
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wiir*// 0 ]) is independent of P^, and hence w(*nr*) is independent of “T^; 

thus wU*/^) = v(n*). Similarly w(ir*/T j) = w(ic*A J *// 0 i ) • If U € 7 ^ 
intersects w(tr */P±) t then by hypothesis and Lemma 1, irV/^CU) = 
ir*/Tj(U), i.e., tt^(U) = ^(U) . If no V £ intersects , 

then w('ir*/tj) is independent of T y If V £ intersects w(Tr*/tj)> 
then ^/^(V) =-nr*/rj(V), i-e., itj(V) = Tj(V) . Since for U Q U^, 

k / i, k ^ j, Tt*(U) = it*Ai(U) “ ir*Aj(U), the equalities follow by 
Lemma 1 . 

Theorem 1 plays no role in the subsequent development. However, 
it illustrates a form of structural relationship among plays and strategies 
which is lost by a transformation to the normal form of a game. 

In the same way that an n+ 1 -tuple it* of strategies defines a 
single play, an n-tuple of strategies ir defines a subtree K(tt), where 
each branch point is a chance move. The end points of K(ir) are designated 
by W(TC) = (w| there is a ir o such that w = w(Tr o ,Tt)}. 

LEMMA 2. W(ir) = W(/°) if and only if w(it 0 , 7 T) = 
w( 7 r o ,/°) for every TT 0 - 

PROOF. Sufficiency is immediate. Necessity: Assume W(ir) = 

\J(P) but for some ir Q , w(ir o ,ir) ^ w(ir 0 ,/°) . Then there is some X Q such 
that w(ir o ,Tr) = w(r Q ,/°). But then by Lemma 1, for every U £ that 

intersects v(X Q ,P) , T 0 (U) = ir Q (U), and for every other U that intersects 
w(T Q ,/>), TT(U) = P(U). Whence wCtc^tt) = v(vr Q ,P), a contradiction. 

DEFINITION i• Let w x designate the subplay ex¬ 
tending from 0 to x, then for x ^ 0, p(x) = 

TL r v p(-v.y), p(o) - i. 
y v tw x 

DEFINITION 5 * The expected pay-off H(n:) for an 
n-tuple of pure strategies it is defined as 

H(lt) - SvGWOT) P (w)h(w) . 

In case w contains no chance moves, p(w) = i; otherwise p(w) 
is the product of the probabilities of those alternatives at chance moves 
in w which lead to further members of w. Note that p(w) depends only 
on p(V,U), U Q and is independent of the strategies of personal players 
however, the relation holds 


Sw6W(7T) P (W) = 1 
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$ 3« THE REDUCED NORMAL FORM OF A GAME 

A list of pure strategies for each personal player of P and a 
specification of the expected pay-off H(ic) for each n-tuple of pure 
strategies is called by von Neumann and Morgenstern the normal form of p. 
When H(ic) is expressed in matrix notation as an n-dlmensional array it is 
called the pay-off matrix of p. 

In the transformation of games from extensive to normal form a 
certain kind of redundancy often appears, namely duplications in the pay¬ 
off matrix of rows or columns ("hyper-rows" in the case of n-person games.) 
We shall show below that this redundancy is generally the result of super¬ 
fluous information on the part of one or more players. It is clear that a 
player loses no strategic advantages If duplications are deleted. This 
motivates the definition of a reduced normal form of a game. We first make 
precise the notion of duplication by defining an equivalence relation for 
strategies. 


DEFINITION 6. Tt ± = /° ± if and only if H('ir) = 

H(ir/^) for every ir containing it^. 

LEMMA 3- s is an equivalence relation (transitive, 
symmetrical and reflexive). 

PROOF. Immediate from the definition. 

Let s^, called an equivalence strategy , designate an equivalence 
class of pure strategies for player 1, and S i the set of all such 
equivalence classes. The cartesian product S = S 1 x S 2 x ... x S n denotes 
the set of all n-tuples of equivalence strategies. Let s = 

(s,, s 2 , ..., s n ) denote a member of S. Let H(s) * H(ir) where TtG s. 

DEFINITION 7* The reduced normal form of a game 
P is a list of equivalence strategies for each 

personal player i, and a function H(s) assigning an 
n-tuple of real numbers to each n-tuple of equivalence 
strategies. 

H(s), when expressed as an n-dimensional array, corresponds to a 
pay-off matrix where repititions of hyper-rows have been deleted. 

4 4. EQUIVALENCE OF GAMES 

Under the presumption that mixed strategies are to be allowed, 
all strategical considerations with respect to a game T are summed up in 
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the reduced normal form. This leads us to consider two different games as 
being equivalent if their reduced normal forms are identical except for 
possible permutations of the lists of strategies. 

DEFINITION 8. V is equivalent to P' — in sym¬ 
bols, p s p* — if and only if there is a one-one 
correspondence between and S| for each i ^ 0, 
such that under this correspondence H(s) = H' (s *) - 

LEMMA 4 . = is an equivalence relation for games. 

PROOF. Immediate from the definition (since the one-one cor¬ 
respondences and equality of pay-off are equivalence relations). 

{ 5 - EQUIVALENCE OF INFORMATION PATTERNS 

Definitions 6 and 8 characterize a kind of equivalence which is 
not very profound in the sense that it depends on the pay-off functions and 
the particular probability distributions at chance moves. A more revealing 
analysis is afforded if we deal with equivalences (to be called essential 
equivalences ) that hold irrespective of the pay-off and probabilities at 
chance moves. 

Consider two game structures (K,U), (K 1 ,U') where K = K' and 
Hq = Uq'' For convenience * we shall say that p is identical with p' 
when p(y,U) = p'OvSU') for every U G 2 ^. This Identification seems 
reasonable in light of the fact that for any U $ p(v,U) = 1 for every 
V. With this convention in mind, we define. 

DEFINITION 9 . Let (K,U), (K' ,tt') be two game 
structures where K * K', ^ • (YL,U) Is said to 

be essentially equivalent to (K 1 ,t6') -- in symbols, 

(K,tt) - (K',U') — if and only if P(K,U,h,p) s 
P(K* ,U',h,p) for every h and p for which 
r(K,W,h,p), P(K* ,h,p) are games. 

LEMMA 5 • ' ~ is an equivalence relation for game 
structures. 

PROOF. From Definition 9 and Lemma 4 . 

THEOREM 2. (K,U) - (K,W) Implies P ± = ? x ' for 

every i. 
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PROOF. The theorem states that the moves assigned to a given 
player by U must be assigned to the corresponding player by U '. The 
theorem holds by assumption (Definition 9 ) for P Q , P 0 *. Suppose P^ / P^» 
for some i. Then there is an x G P^^ such that x G P' k , k^i. We may 
assume that there are at least two alternatives at x (otherwise x is a 
trivial move and can be eliminated). Let x G U G and x G V C 
Let h be as follows: 


1 ) 

hj(w) 

h^(w) 

* 0 

for all 

w 

and for all j / i 

2 ) 

= 0 

for all 

w 

such that x 1 ( v 

3 ) 

^(w) 

* 1 

for all 

w 

such that x 1 Gw 

*0 

h^w) 

—1 

for all 

w 

such that x 2 G w. 


With this h it is immediately clear that we can never have > o, 

%(/*) < 0 where Let ir^» and be strategies for player k 

in (K,T 4 *) such that ^'(V) = 1 and /^'(V) = 2, and both and 

Z^* realize x. Let T be any n-tuple of strategies that realizes x. 

> o, H^t/Z^') < 0, hence there is no equivalence strategy in 
P(K,2*,h,p) corresponding to the s i » in P(K,U* ,h,p) containing T^. 

Theorem 2 assures that there is no loss of generality in 
specializing to the case P « P'. For the next step, we specialize even 
further, and consider the case of a fixed (but arbitrary) information pat¬ 
tern XL - for all players but one, and examine the effect of varying 
In this uncomplicated case it is convenient to overlook the fact that 
we are dealing with two different game structures, and identify all the 
components, except the information pattern and strategies for the player i. 
With this convention it becomes meaningful to write, for example, 10 ^*, 
where Tt is an n-tuple of strategies originally defined for (K,J6) and 
is a strategy for player i in (K‘). This convention has the 
virtue that it saves most of the labor of trivial proofs of one-one cor¬ 
respondences . 


DEFINITION 10. Let (K,tt), (K,]£') be two game 
structures where U - = U* - . A pure strategy 

for player i In (K, 24 ) is said to be essentially 
equivalent to a pure strategy for player I in 

(K,U*) — in symbols - tr^' -- when H(ir) = H(it/rr 1 ') 
for every tr containing Tt^ and every h and p for 
which T(K,U,h,p), P(K,U* ,h,p) are games. 

LEMMA 6. Let (K,U) and (K,t 4 ') be as in Defini¬ 
tion 10. Then (K, 2 t) ~ (K, 2 £') If and only if for every 
pure strategy for player I in (K,t£) there is a 
strategy for player i in (K/j^') such that 

~ and vice versa. 
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PROOF. Sufficiency. If Tj 3 /j, j ^ i, in P(K/tt,h,p) then 
T. s in P(K,26' ,h,p). For, assume the contrary, then H(ir) * H(lt//°j) 
for every it containing Tj, but for some it’ containing T y H(lf') / 

Let Hj/ be the strategy of the i'th player in -it*. By 
hypothesis there is a ir^ such that H(it) = HOr/nr^ 1 ) for every 1C con¬ 
taining r ± ; in particular iKit'/lt^) = H(ir*). But by hypothesis 
H(it'Aj_) = H(ic , /it 1 //°j), since it' contains T\ and s /°j. But also 
by hypothesis Htir'/iTj/Pj) = H(ir'/iif^/Z^/it^') = H(lt'//^). Whence H(it') = 
H(it*/^j), which is a contradiction. Similarly, Tj s in P(K,U',h,p) 
implies Tj s in P(K,U,h,p) . Whence, the equivalence strategies Sj 
in P(K,1£,h,p) for j ^ i correspond one-for-one with the equivalence 
strategies S^' in P(K,tt',h,p) . We define a correspondence s 1 h s i * by 
the rule: if TT^ G s i then ir^ 1 G s^ 1 where ir^ 1 ^ ir^. Clearly, if 
= i^, then for every P i * ~ 5 if^ 1 , whence the correspondence 

Is one-one. The equality H(s) = H(s') for this set of correspondences 
follows immediately from the definition of - for strategies. 

Necessity. Suppose that there Is a it^ in (K,U) such that 
there is no IT^ 1 in (K,U') for which ir^ * . Then there is some h 

and p and some ir containing such that H(lt) ^ H(1t/1T^ 1 ) . This 

violates the assumption that (K,U) - (K,U'). 

THEOREM 5- Let (K/26), (K,U') be two game struc¬ 
tures with V, - = Vs - 1 . The following are 

necessary and sufficient conditions for If^ - /^, where 
is a strategy for player i in (K,U) and is 

a strategy for player i in (K,1jt') • 

1) W(7f) = WCir/^) for every if containing It^. 

2 ) w(ir*) = wCtt*//^) for every it* containing ir^. 

PROOF. (I) 1) implies ir^ * This is immediate, since If 

W(ir) = WfTr/Z^) then H(rr) = H(if/Z^) for every if. (ii) cr ^ implies 
2). Suppose there is some rt* containing if^ such that w(it*) ^ w(it*/^). 
Then there is no T* such that w(T*//>j_) = otherwise, by Defini¬ 

tion 5, T*//°i( x ) = it*(x) for every x G w(it*) and hence, by Definition 3 
again w(t*/^j_) = = w(ir*) . Let p be arbitrary and set 

h^(w) = 0 for every w P w(it*), and set h^wCir*)) = 1 . Then H^Cir) > 0 
for some if containing if^, whereas H^(it/Z^) * 0 . (iii) 2) implies 1). 
Immediate. 


DEFINITION 11. A set of positions B (not neces¬ 
sarily an information set) Is said to be realizable by 
IT^ if there is a it* containing if^ and B inter¬ 
sects w(it*) • Let U G be an information set and B 
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PROOF. The theorem states that the moves assigned to a given 
player by U must be assigned to the corresponding player by U '. The 
theorem holds by assumption (Definition 9) for P Q , P Q *. Suppose P 1 P^ 
for some i. Then there is an x £ P^ such that x G P' k , k/ i. We may 
assume that there are at least two alternatives at x (otherwise x is a 
trivial move and can be eliminated) . Let x € U £ and x € V ejty 
Let h be as follows: 


1) 

h j(w) 

= 0 

for all 

w 

and for all j ^ i 

2) 

h^v) 

= 0 

for all 

w 

such that x 1 $ w 

3) 

h^v) 

* 1 

for all 

w 

such that x 1 £ w 

1*) 


=-1 

for all 

w 

such that x 2 G w. 


With this h it is immediately clear that we can never have H^(fT) > o, 
Hj^/ 0 ) < o where 1t^ * /^. Let ir k » and /° k ' be strategies for player k 
in (K,t£') such that 71^'(V) = 1 and /° k '(V) = 2, and both and 

/° k ' realize x. Let T be any n-tuple of strategies that realizes x. 
H^(r/ir k ») > o, Hj L (t//^ c ') < 0, hence there is no equivalence strategy in 
P(K,2£,h,p) corresponding to the s i * in r(K,U* ,h,p) containing . 

Theorem 2 assures that there is no loss of generality in 
specializing to the case P = P*. For the next step, we specialize even 
further, and consider the case of a fixed (but arbitrary) information pat¬ 
tern VL - for all players but one, and examine the effect of varying 
y^. In this uncomplicated case it is convenient to overlook the fact that 
we are dealing with two different game structures, and identify all the 
components, except the Information pattern and strategies for the player i. 
With this convention it becomes meaningful to write, for example, 
where it is an n-tuple of strategies originally defined for (K,U) and 
is a strategy for player i in (K*). This convention has the 
virtue that it saves most of the labor of trivial proofs of one-one cor¬ 
respondences . 


DEFINITION 10. Let (K,U), (K,14') be two game 
structures where U - ^ = U* - . A pure strategy 

for player i in (K,2£) is said to be essentially 
equivalent to a pure strategy 71^' for player i in 
(K,U*) — in symbols ir ± ? n ± ' — when H(ir) - E(lt/K ± •) 
for every it containing ir^ and every h and p for 
which T(K,U,h,p), P(K,U',h,p) are games. 

LEMMA 6. Let ( K,U ) and (K,tt*) be as in Defini¬ 
tion 10. Then (K,?6) * (K,tt') if and only if for every 
pure strategy fox;, player i in (K ,11) there is a 

strategy X^' for player i in ("&,%') such that 
~ IT^ 1 and vice versa. 
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PROOF. Sufficiency. If Tj s J ^ in P(K,3£,h,p) then 
s /°j in P(K,U* ,h,p). For, assume the contrary, then H(ir) - H(it//°.) 
for every ir containing Xy but for some it' containing Tj, H(ir r ) ^ 

HCir'/^j). Let ir^* be the strategy of the i'th player in it*. By 
hypothesis there is a 7such that H(it) = HCTt/rr^ 1 ) for every it con¬ 
taining ir^; in particular iKit'/ 1 ^) = H(ir') . But by hypothesis 
H(it'Ai) = H(ir , /ir i //°j), since it* contains V. and T. = Py But also 
by hypothesis H(lt , /ir i //°j) - Hdr'/n^/^./^') = Hdt'/^j)- Whence H(it') * 
Hfir'/Pj), which is a contradiction. Similarly, TL = />. in P(K,26' ,h,p) 
implies Tj s in P(K/U,h,p) . "Whence, the equivalence strategies Sj 
in P(K,^,h,p) for j ^ i correspond one-for-one with the equivalence 
strategies Sj' in P(K,t6*,h,p) . We define a correspondence f» s^ by 
the rule: if 7T^ £ s i then tr^' Q s i * where 1T^* - ir^. Clearly, if 
P^ = then for every P^' - P^, P^' s , whence the correspondence 

is one-one. The equality H(s) = H(s') for this set of correspondences 
follows immediately from the definition of ~ for strategies. 

Necessity. Suppose that there is a ir^ in (K,U) such that 
there is no It^ 1 in (K,7X') for which - TT^ 1 . Then there is some h 
and p and some ir containing such that H(ir) ^ This 

violates the assumption that (K ,U) - (K,U*). 

THEOREM 3- Let (K/26), (K,U*) be two game struc¬ 
tures with TA - = U‘ - 1 . The following are 

necessary and sufficient conditions for 1- P^, where 
It^ is a strategy for player i in (K,U) and P^ is 
a strategy for player 1 in (K,id f ). 

1) W(ir) = W(ir//^ 1 ) for every nt containing ir^. 

2) w(it*) = w(Tr*//° i ) for every it* containing ir^. 

PROOF, (i) 1) implies ir^ * Py This is immediate, since if 

W(ir) = W(it/p ± ) then H(ir) = K(k/P ± ) for every it. (ii) n ± * /> ± implies 
2) . Suppose there is some it* containing ir^ such that w(it*) ^ v(ic*/P±) • 
Then there is no T* such that w (T*/p±) = w(n*), otherwise, by Defini¬ 
tion 3, T */p^(x) - ir*(x) for every x £ w(it*) and hence, by Definition 3 
again w(t*//*i) = w(it*//°i) = v(it*) • Let p be arbitrary and set 
h^(w) = 0 for every w ^ w(it*), and set h^(v{jc*)) - 1. Then H^Oc) > 0 
for some ir containing ir^, whereas = 0. (iii) 2) implies 1). 

Immediate. 


DEFINITION 11. A set of positions B (not neces¬ 
sarily an information set) is said to be realizable by 
It^ if there Is a it* containing and B inter¬ 

sects w(it*). Let U G be an information set and B 
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a subset of U. B is said to be isolated in U when, 
for every ir 1 , if B is realizable by i^, then 
U - B is not realizable by 

LEMMA 7* Let U v designate the set of positions 
which follow any move in U by choice of the y'th 
alternative.. B is isolated in U if and only if 

for every x € B, y € U - B, there is a V G such 
that x G V v , y G V,j and y ^ >f. 

PROOF. Sufficiency. Consider any ir^, and assume Tt^ realizes 
some x G B and yGU-B. By hypothesis, there is a VG^ such that 
x £ V v , y G Vtj, V / 7 . But if realizes x, then 1t^(V) * v by Def¬ 

inition 3 , whereas if 71^ realizes y, then n^(V) = which contradicts 
the definition of strategy. 

Necessity. Assume that for some xGB, yGU-B, for every 
V G such that x G Vy, y G then V * 7 . Let ir^ realize x and 
/*£ realize y. We construct a T ^ so that for every V G such that 
w x intersects V, T^V) * ^(v) and for every V G such that w y 
intersects V, T(V) = /^(V). Then realizes both x and y, hence B 
is not isolated in U. 


DEFINITION 12 . a) Let (K ,U), (K,74') be two 
game structures, where P i 

v 


immediate inflation of 


p i'-% 
when there is a 


is said to be an 


G ^ ± ' 


and U,, U 0 G ^ such that U ± - (U^Ug) = 2^' - (V) 


and 


U 1 ,U ( 


2 - 

are isolated in 


b) 


2 

% 


V. 


is an inflation of U* 1 when there is a 


finite sequence 


and 

Y^, i 


%L' 


“ ^i 
1 , 2 , 


and 


yl y2 

L i' Tii 

tT 

1 - l. 


• • • f 


-I 

such that 


% 




is an immediate inflation of 


c) 26^ is completely inflated when there is no 
such that is an Inflation of U^. 

d) is a complete inflation of if is 

an inflation of U^' and VL^ is completely inflated. 

e) is an inflation (complete inflation) of 
when 14^ is an inflation (complete inflation) of 
for every i. 


THEOREM Let (K,24), (K,24*) be two game struc¬ 
tures where U - - U* - , and 74^ is an immedi¬ 

ate inflation of U ± ', then (K,U) * (K,24*). 
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PROOF. Let VG^', U 2 be the sets required by Defini¬ 

tion 12a. Let i^' be any strategy for player i in (K,U»). Let 
be the strategy in (K,U) such that for every V' ft V, ^(y) - ^'(V') 
and ir^OJj) *= 1Z^(U 2 ) = *^'(V), then for, let ir* contain ir^, 

then w(it*) = wOr*/^*) by Lemma 1* and hence ir^ - ^ by Theorem 3* 
Consider any ^ in (K,24) . If ^ does not realize V, then there is 
a ^'(U) * ^(U) for U / V, ana by Lemma 1 ^ . if 

realizes V, then, since U 1 and U 2 are isolated in V, ic^ can realize 
either U 1 or U 2 , but not both. Let it realize U 1 and let H^'dJ) * 
^(U) for every U / V, and (U 1 ) = *^(V) . Since, by Lemma 1, 
does not realize U 2 , ^Whence, the theorem follows by Lemma 6. 

COROLLARY 4a. If (K,U ), (K,&') are identical 
game structures except that is an inflation of 

for some 1, then (K/Z4) - (K,24‘) . 

PROOF- Theorem 4 and Lemma 5 . 

COROLLARY 4b. If (K,24), (YL ,%') are game struc¬ 
tures such that for every i either = U^' or 74^ 
is an inflation of / IX^ or is an inflation of 

then (K f 7L) * (K,^'). 

PROOF. By repeated applications of Corollary 4a. 

THEOREM 5* If (K ,U) * ) where % - U x = 

U* -76^', and both 'LL ana VJ are completely in¬ 
flated, then 11^ = U^ 1 • (Two equivalent completely 
inflated information patterns are identical.) 

PROOF. Let (K,^6), (K ,U') be as in the hypothesis, and assume 
—i ^ :i*• There is no loss of generality in assuming that there is a 

V G < Z6 i ‘ and U 1 , U 2 G 24^ such that both U 1 and U 2 intersect V. Con¬ 
sider any strategy in (K,7L') • IT^’ cannot realize both V n U 1 and 

V n U 2 , for suppose it did; then there is a in (K,U) such that 

TC i “ 1t i , » hence realizes both U 1 f\ V and U 2 n V. We define a P^ 

such that for every U' G U^, U' ft U 1 and U' ft U 2 , P^( U*) = ^(U f ) and 
/VV ft P ± ( u 2 ). Now realizes both U 1 n V and U 2 /) V, and there 
is no P^' in (K,^) such that P^ x « P^, since there is some tc* con¬ 

taining P^ such that w(*Tt # ) G V v and another if* containing P^ such 
that w(if*) G V*. Since U 1 and U 2 are any U G^ that intersect V, 
each is isolated in V, which contradicts the assumption that % L » is 
completely inflated. 



228 


LALKEY 


COROLLARY 5a. An information pattern for 
player i has a unique complete inflation. 

PROOF. Immediate from Theorems 4 and 5* 

THEOREM 6. (K ,U) - (K,W) where U - 2£ ± * 

TZ' - if and only if the complete inflation of ^ 

is identical with the complete Inflation of TZ^*. 

PROOF. Corollary 5a assures that the unique complete inflations 
of 3^ anc * exist. Sufficiency follows from Theorem 4, necessity 

from Theorem 5* 


COROLLARY 6a. (K,U) * (K,tt*) (where U Q = V^') 

if and only if the conplete Inflation of is 

identical with the complete Inflation of for 

J 

every j. 

PROOF. Theorem 6 and Corollary 4b. 

REMARK. The rather tedious route whereby we arrive at Theorem 6 
and Corollary 6a can be bypassed Intuitively by the following heuristic 
discussion. Theorem 4, which is not used directly in the proof, indicates 
that inflation is essentially a process of adding to a player*s information 
at a given move, some further knowledge about his own previous moves (where 
this additional information has no implications for previous moves of other 
players.) But If a player is proceeding according to a preformulated pure 
strategy, and has complete information about the structure of the game, 
then at any move where It is his turn to pla>, his strategy will tell him 
what previous moves he has made. Hence, information solely about his own 
previous moves is superfluous. Presumably, a player*s memory of a strategy 
will be equally complete whether it results from a direct choice (pure 
strategy in the strict sense) or from a prior selection of a pure strategy 
by some chance device (mixed strategy). However, it is clear that If the 
player is using behavior strategies — i.e. mixes by some chance selection 
at each of his moves — there is no guarantee that he will remember all 
previous selections. This is true particularly where a player is repre¬ 
sented by a team of persons, each assigned to different information sets. 
For this reason -- as Is readily verifiable -- Theorem 6 does not hold for 
behavior strategies. 
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$ 6. DEFLATION 

So far our emphasis has been on the inflation of information 
patterns. However, from the practical point of view -- i.e., from the point 
of view of simplifying games — inflation is not as interesting as its 
converse, deflation . 

To illustrate the order of reduction in size of pay-off matrices 
by deflation, in tic-tac-toe the first player has roughly io 51,00 ° pure 
strategies (if we ignore the effect of the stop-rule anc. assume that each 
play of the game results in completely filling the open squares.) In 
essentially reduced form, the first player has only 10 127 pure strategies. 
Although this second figure is still ridiculously large, it is clear that a 
tremendous reduction in size of the game is achieved. The pleasant feature 
is that this reauction can be carried out by operations directly on the 
game structure, without first constructing a cosmic sized matrix ana then 
eliminating duplications. 

Unfortunately, we cannot assert that every Information pattern 
has a unique complete deflation. Consider the game p illustrated below. 
The ellipses represent information sets for the lnaicated players. 



As It stands U 1 is Inflated; player 1 at his second move knows 
which first move he made. In fact, is an inflation of ' * in 
P 1 and p*' respectively. 
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Both • and *• are completely deflated. It is easy to verify that 
in this case there remains a certain amount of redundancy in the informa- 
. tion pattern, in the sense that in both P* and p* * there are two or 
more strategies that are essentially equivalent. 

i T. ESSENTIALLY DETERMINATE GAMES 

In the preceeding sections we were guided by a more or less in¬ 
tuitive notion of equivalence, based on the presumption that the normal 
form of a game completely exhausts the strategic possibilities. It would 
be desirable to base our investigations on a set of rules for playing a 
game "in a rational fashion. Unfortunately at present the rules for rational 
play can be considered as being in a satisfactory state only for one-person 
and two-person zero-sum games. There is, however, a form of weak solution 
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for general games that has been suggested by Nash [ 3 ] which at least can be 
used for exploring some of the properties of information patterns, and 
which, in the zero-sum two-person case reduces to the accepted mini-max 
rule. This is the notion of equilibrium point. Since we have defined only 
pure strategies above, we limit ourselves to equilibrium points in pure 
strategies. 


DEFINITION 13- A pure strategy n-tuple it is an 
equilibrium point if and only If H 1 (^) > H i (‘ir/ / \) for 
every i and every 

DEFINITION 14. (K,Zt) Is said to be essentially 
determinate if P(K,2*>h,p) has an equilibrium point in 
pure strategies for every h and p for which 
P(K/tt,h,p) Is a game. 

LEMMA 8. If (K,U) * (K,£t') then (K ,U) is 
essentially determinate If and only if (K,^ 1 ) is 
essentially determinate. 

PROOF. Immediate from the definitions of * and essentially 
determinate. 

Kuhn has shown [ 2 ] that a sufficient condition for a game struc¬ 
ture (K,W) to be essentially determinate is that (K ,U) have perfect 
information.^ 


DEFINITION 15• (K ,U) is said to have perfect 
information if every information set U is a unit set. 

It is clear that no essential modification results if we restrict 
the information sets in Definition 15 to personal information sets. 

It is easy to find examples of games which are essentially de¬ 
terminate and which do not have perfect information. In fact, any one- 
person game is essentially determinate Irrespective of the nature of the 
information pattern (see Lemma 10 below) . Hence, perfect information is 
not a necessary condition for essential determinateness. 

Let U < V mean there is a play w which intersects both U 
and V and the intersection of U and w preceeds the intersection of V 


^Strictly speaking, he proved something slightly different from this; but 
the step to showing essential determinateness is trivial, amounting, in 
fact, only to pointing out that both h and p can be chosen arbitrarily. 
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and w. We shall also use the notation occasionally x < U, which means 
there is a play w containing x that intersects U, and x proceeds 
the intersection of U and w. 

DEFINITION 16. (K ,U) is said to have effectively 
perfect information when, for every pair of personal 
information sets U, V such that U G U^, V G 
k i, if U < V then V C U y for some V. 

Note that the definition says nothing about the relation of in¬ 
formation sets of the same player, nor about the relation of personal in¬ 
formation sets to chance moves. In intuitive language, a player is said to 
have effectively perfect information if at any move where it is his "turn” 
he "remembers” every previous move of each of his personal opponents and 
knows at least as much as the opponents knew when they made those moves. 

LEMMA. 9. Every one-person game has effectively 
complete recall. 

PROOF. Immediate from the definition. 

LEMMA 10. Every one-person game Is essentially 
determinate. 

PROOF. Since H(ir) (= ) Is a function of only one variable 

over a finite domain, it admits a simple maximum. 

We first show that a game with effectively perfect information 
can be decomposed into a directed set of subgames (ordered by inclusion), 
each of which can be examined for equilibrium points Independently of all 
succeeding subgames. The notion of subgame involved is somewhat wider than 
the direct application of Definition 1. 

DEFINITION 17* Let B be a set of positions (not 
necessarily an information set) and D(B) the set of 
all positions that follow any position In B, i.e. 

D(B) * ly| there is an x G B and y G D(x)). Analo¬ 
gously, D(*v,B) is the set of positions that follow B 
via the Vth alternative, i.e. D(V,B) * (y| there is 
an x G B and y G D(v,x)). We will write x < U to 
mean x < U or x G U. By the greatest lower bound 
(g.l.b) of B is meant the x of highest rank that is 
contained in every w that intersects B. V < B 
means V < B or V intersects B. 
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A. A set of positions B is said to define a 
subgame Pg when: 

1 ) For every personal information set V < B, 

B C V v for some v. 

2 ) For every personal information set V > B, 

V C D(B) u B. 

B. A pure strategy for a player i in P- is a 
function, , that maps every V G V > B, onto 
an integer v < m(V) . We shall also use the expression 

■n — 

to designate the strategy ir^ limited to Pg 
(i.e. is the strategy for player i in Tg such 

that ir ± B (V) - -^(V), V > B, V G U v ) 

C. W(ir B ) = lw|w £ D(B) and for every personal 
move y > B, y £ w implies y v £ w where it^y) = v) 

D. Let p(B) = P(y) • For x > B, p fi (x) - 

E. HOnr 6 ) - V xx Pta(w)h(w) . 
wGWCir 6 ) B 

A rough justification for calling Tg a subgarae is the following 
(a more precise justification is found in Lemmas 11 - 13 below): Defini¬ 
tion IT A2 states that B Isolates a certain portion of K, namely 
B u D(B); no personal information set overlaps B U D(B) and the rest 

of K. 17 A1 assures that one and only one set of choices on all personal 

information sets V < B will realize a position in B U D(B) . Thus, given 
a it which realizes B, the selection of a strategy within Pg can be 
made Independently of the remaining part of P. Note that (0) defines a 
subgame P{ 0 )> namely, P itself. 

The significant elements for a subgame Pg, namely strategies 
and expected pay-off, are defined in a manner quite analogous to those for 
a complete game, with g.l.b. B replacing o. We cannot, however, simply 

define a subtree, say Kg, which begins at g.l.b. B and let Kg with 

its Information pattern define a subgame structure, since in the first 
place, there may be many personal information sets between g.l.b. B and 
B which overlap Kg and the rest of K, and secondly. Kg may be much 
more extensive than the part of K which is isolated from B onward. 

LEMMA 11. If B defines a subgame, then for x, 
y G B, g.l.b. (x,y) is a chance move, or B is a 
unit set. 

PROOF. Suppose B is not a unit set and x, y G B. Then g.l.b. 
(x,y) $ B. But g.l.b. (x,y) cannot belong to a personal information set 
by Definition 17 Al . Whence g.l.b. (x,y) is a chance move. 




DALKEY 


2}k 


LEMMA. 12 . If B defines a subgame P fi , then for 
every it that realizes B, H(it) * pCBjHflt®) + T(it) 
where T(ir) is independent of ir B . 

PROOF. If it realizes B, then W(u B ) - W(ir) n D(B). Thus 

H(tc) = V ra p(v)h(v) + T(it) where 
^v6W(n B ) 

T(lt) *V „ p(w)h(w), whence 

^wGWOO-WdO 

H(it) - p(B) V p R (w)h(w) + T(it) 

^wGW(n B ) B 

= p(B) H (it B ) + T(«) . 

If w G W(ir) - M(tP) , then w does not intersect B, and 
hence, by Definition IT A2, does not intersect any personal V > B. Whence, 
if It and P are identical for all personal V > B, T(it) * T(^). 

LEMMA 13- it is an equilibrium point for P if 
and only if it B is an equilibrium point for every P fi 
which is a subgame of P, and for which K(it) inter¬ 
sects B. 

PROOF. Sufficiency is immediate since P is a subgame of itself. 
Necessity. If it® Is not an equilibrium point of P fi , there is an i 
and a such that H 1 (ic B |/° 1 B ) > . Let /» ± he Identical with 

except in Pg, where it is identical with ■ Then by Lemma 12 
Hi(ir| /*i) > H^(it), and it Is not an equilibrium point in P. 

DEFINITION 18 . If U and V are personal in¬ 
formation sets, U Is said to be connected with V 
when there is a sequence of personal Information sets 
U 1 , U 2 , ..•, U 1 such that 0 - U 1 , V = U 1 and for 
each i there is a w that intersects U 1 and U 1+1 , 
and U 1 <t U 1 * 1 , U 1+1 <t for any V. 

« 

LEMMA 14. Connected is an equivalence relation. 

PROOF.’ a) Transitivity. If U is connected with V and V 
is connected with V*, then there is a sequence U 1 , U 2 , ..., U 1 con¬ 
necting TJ and V and another sequence V 1 , V 2 , ..., V 11 connecting V 
and V*. The sequence U 1 , U 2 , TJ 1 , V 2 , .... V* 1 Is a sequence of the 
required sort connecting U and V*. 
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b) Symmetry. Immediate from the definition. 

c) Reflexivity. Immediate. 

DEFINITION 19* Denote the set of equivalence 
classes of information sets under connected by C * 

(C 1 , C 2 ...}. Let %C = (x| there is a U £ C and 
x£U), then B(C) - lx|x £ X C and there is no 
y £ X y < x) i.e., B(C) consists of the minimal 
points of Sc. 

LEMMA 15* If C £ C then B(C) defines a subgame. 

PROOF. (1) Let U be any personal information set, U > B(C), 
i.e., there is some w that intersects U and B(C). Let w intersect 
B(C) in V. If U t V v for some V, then U £ C, and hence every w 
that Intersects U intersects B(C) . If U C V v for some v then again 
every w that intersects U Intersects B(C). 

(2) Let U be any personal Information set, U < B(C). U $ C, 
since B(C) is minimal. There is a w that intersects U and intersects 
B(C) in say x £ V £ C, hence V C Uy for some V, otherwise U £ C. 

Let V* be any other information set in C. By definition V and V* 
are connected by a sequence V 1 , V 2 , ..., V 1 , V = V 1 , V* = V 1 . We have 
shown that V 1 C Uy for some V. Assume that V* 1 C U y . There is a Wq 
that intersects V^' and V J+1 , and every w that Intersects inter¬ 

sects U; hence, ^ intersects U and V^ +1 . Now U <t V^ +1 for any 
i|, since U < B(C); whence if V J+1 t Utj for some yf, U £ C. Thus 
V^ +1 C Utj for some rj, and >| = V since, by assumption, ^ follows the 
Vth alternative at U. Therefore there is a V such that for every 
V £ C, V C U y . A-fortiori, B(C) C Uy. 

DEFINITION 20. An equivalence class C is said 
to cover an equivalence class C' when B(C) < B(C») 
and there Is no C'* such that B(C) < B^’’) < B(C*)- 

LEMMA 16 . If C covers C', then for every 
U £ C», U > B(C), and for every V £ C, if there Is a 
w that intersects V and B(C*)> B(C') C Vy for 
some v. 

PROOF. Lemma 15 • 

Lemma 16 says in effect that if an equivalence class C preceeds 
another equivalence class C*, then B(C') defines a subgame of • 
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LEMMA. 17- Two different equivalence classes can¬ 
not cover the same equivalence class. 

PROOF. Suppose C and C’ both cover C**. By Lemma 16 every 
w that intersects BfC**) intersects both B(C') and B(C). Since B(C) 
and B(C*) are not identical, we must have either B(C) < B(C*) or 
B(C•) < B(C). In which case either C or C* does not cover C ,f . 

If the first position 0 of (K,U) is a personal move, the C 
containing 0 defines the entire game T. If o £ P Q , It is possible 
that no C determines the entire game. In this case it is convenient to 
extend the definition of £ so that {o) t £. In either case, we designate 
the C containing 0 by C Q . 

THEOREM 6. C is a tree under the relation covers 
with a distinguished vertex, C Q . 

PROOF. Let h- denote the proper ancestral of covers , i.e., 

C >-C' If and only If there is a sequence C 1 , C 2 , ..., C n such that 
C - C 1 , C* = C n and C i covers C i+1 . y- is transitive by definition and 
asymmetrical by Lemma 16 and the a-cyclicity of the ordering relation 
on K. C o V0 for every C ^ C Q . Finally, If C 1 h- C, C 2 y- C, then 
either C 1 C 2 or C 2 y- C 1 by Lemma 17 . 

LEMMA. 18 . If (Khas effectively perfect in¬ 
formation and C G C then C C ^ for some i. 

PROOF. Let V G C, V G tf., be any information set In C. Con- 

1 2 h 

sider any U G C. U is connected with V by a sequence U , U , ..., U . 
But if U 1 6 then U i+1 6 U ± since, by assumption, if U 1 " 1 U ± , 

then either U 1 C U 1 ^ 1 or U 1+1 C u£, and U 1+1 $ C. 

Lemma 18 shows that in the tree C, the transition from a set of 
subgames to a covering subgame involves only one player. 

THEOREM 7• A necessary and sufficient condition 
that be essentially determinate is that the 

complete inflation of (K,U) have effectively perfect 
information. 

PROOF. Sufficiency. The restriction to the complete inflation 
of (K,U) Is required only for necessity. Hence, assume that (K ,V,) has 
effectively perfect information. We show sufficiency by exhibiting, for 
any h. and p, a strategy n-tuple ir which is an equilibrium point. By 
* minimal 0 Q C we mean one for which there is no C• such that C hC‘- 
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It is clear that a minimal C defines a one-person subgame. To simplify 
notation, rather than writing and we will write and 

it^. 

(1) For each minimal C,aP (= vp where C C U^) is so chosen 

that 

H l (ifC) > H l (ffC /^i C) 

(2) For any C, it°(V) = it 0 '(V) for VtC', C(-C. ^(U), 

U G C, is chosen so that 

H k (sC) > H k (ffC / / i C) ' c c v*. 

where (V) = it 0 ’ (V) for V £ C 1 , C f- C 1 . To show that any ic con- 
strueted according to the above recursive rule is an equilibrium point, 
let P^ be any strategy for player i, and let P^ , P^ , ... be a 
sequence of strategies for player i constructed as follows: (a) P^ « 
P^, (b) P^ is identical with P^ + ' except for the C — which we 

shall call C - — of highest rank which intersects K(ri/P^) and for which 

P^ (V) ^ tt^VJ for some V £ Cj. Note that Cj C U^- (In case there are 
two or more C of equal rank of the specified kind, let Cj be any one of 
these.) (c) For V > B(Cj), /^ +1 (V) - ^(V) . Now by Lemma 12 and the 
definition of ft 

H i (S /'i J+ ’ ) > 

Since there are only a finite number of C's which Intersect K(1C /P^) and 

the step from P^ to /° i ^ +1 requires a reduction In rank (or at most a 

finite number of steps before a reduction in rank), the sequence P^ must 

conclude with a P^ such that K(if// > i 1 ) = K(*r), whence H^(ic /P^) - 

H^TC) and therefore H^it) > H^Tt /P^) • 

Necessity. Assume that (K,2£'), the complete inflation of 
(K,U) does not have effectively perfect information. Let x Q £ U G 
be the personal position of lowest rank for which there is z £ D(x Q ), 
z G V £ 16j ’, I / j, V t Uy for any V (if there are several positions of 

the same minimal rank with this property, let x Q be any one of these); 

and let xGVGt^', k/i, be the position of lowest rank in D(x Q ) 
such that V t Uy for any V. Since x G D(^,x Q ) for some )j, there is 
a y G V such that y $ D(7|,x Q ). For simplicity we relabel the persons 
and alternatives so that U C VC P 2 , x G D(i,x Q ). We distinguish 
three principal cases: 

CASE I. x Q - g.l.b. (x,y). 

Let W » D(x) u D(y) and let m = max [rU,), Define 
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h(w) as follows, where z is the highest ranking intersection of w with 
w ( ft 

1- z € P Q : h^w) - 0 for every i. 

2. z ( P 0 , z < (x 0 )s h ± (w) - for every i. 

3. z i P 0 , z > lx 0 ): h^w) - Jjlj. for every i / 1, 

hi (v) = for z|P, otherwise h,(v) - . 

w G W. 

1 . i / 1 , i / 2: h ± (w) = j^ry . 

2 . 1=1 or 

v G D(x,) 

v G D(x 2 ) 
v 6 D(y v ) 
w G D(y 2 ) 

With h as defined, no ic Is an equilibrium point. There are 
two possibilities: 


2 : 

h, (w) 

h 2 (w) 

m 

m+1 

p(x) 

p(x) 

m+1 

m 

pW 

pTx) 

m+1 

m 

p(y) 

p(y) 

m 

m+1 

p(y) 

ptyT 


—x 


or w_: 
-y 


(a) 


(b) 


A. K(ir) n ff = e. 

Let z 6 U G Ujj' be the highest ranking Intersection of 

K(ir) with w_ or v; and let P^ be Identical with IT,, 
“* fiT\ y _ K K 

except that f k = V where zy 6 w x or Wy. Then 

H k (V^ k ) > r(z y ) > r(z) = H k (T) 

B. K(lt) flS+9. 

The pay-off to any player Is Independent of choices made 
above 7; hence there are essentially four cases, depending 
on K, (tj) and x^(7); these are summed up In the matrices 
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H 1 (ft ) H 2 (tT) 


\« 2 (V) 

1 

2 

\TT 2 (V) 

1 

2 

IT, (U)\ 



tt, (m\ 



1 

m 

m+1 

1 

m+1 

m 

2 

m+* 

m 

_ I 

2 

m 

m+1 


For any pair of choices itj (U), ^(V), there is a choice by one 
of the players that increases his pay-off. 

CASE II. x Q 4 s g.l»b. (x,y), U intersects w y . 
g.l.b. (x,y) G P Q , otherwise x Q would not be the minimal 
position for which effectively perfect information Inter fails. Let 
y Q G U be the lowest ranking position in w^ such that U intersects w x 
and V ([ U y for any V. Because of the minimality condition on V, U G •. 
Let W, z, and m be as in Case I, and set t = r(x^) - r(y^). Define 
h(w) as in Cj 


(a) 3. 


(b) 2. 


m be as in Case 

I, and set 

t = r(x Q ) - r(y ( 

I for (a) 1,2 and (b) 1. 

z < p 0 > z > lx o ): 

Zip, 

ii 

5 

Zh 

6 

i-|^- for every 

z e w x : h,(w) = 

2 m+1+t 

pTzT 

for z $ P 1 

z e w y : h,(w) = 

2 m+ 'i -t 
p(z) 


h 1< w) -$f} for z £ P 1 



h, (w) 

h 2 (w) 

w 6 D(x,) 

2 m 

2 m+1 

pIxT 

p(x) 

w 6 D(x 2 ) 

2 m+1+t 

2 m 

p(x) 

P(x) 

w 6 D(y,) 

2 m+1-t 

ply) 

2 m 

p(y) 

w 6 D(y 2 ) 

2 m 

pTyT 

2 m+t 

p(y) 


i ¥■ i. 
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The proof that no it is an equilibrium point proceeds as in 
Case I except that a more complicated set of subcases must be examined. 

A. K(ir) n W « 0. Let z be as in Case IA. 

1. z < g.l.b. (x,y): Argument as in Case IA. 

2. z > g.l.b. (x,y): Let z x 0 U x and z y G U y be the 
highest ranking intersections of K(it) with w x and 
Wy respectively. There are two sub-sub-cases. 

(i) Either U x < z y or U y 4 z x : Assume U x 4 z y . 

Let U x G and let P 1 be identical with ir^ except 

that « V where z x G w x - Then 

H ± (ic//^) > r(z x ) + r(z y ) > r(z x ) + r(z y ) = H^ir) 

a similar argument holds in case U y { z x . 

(ii) U x < z y and U y < z x . In this case both U 3 ^, 

U y G , otherwise the minimality conditions on tJ and 
7 are violated. Let Py be identical with iCy except 
that for every U Gjt,*, x > U > z x , /^(U) = V where 
x G D(v,U) . Then H 1 (it//* ) > 2m+r(y Q ) > r(z x ) + r(z y ) = 
H 1 (ft) . The central inequality holds since r(z y ) - 
r(y Q ) < m and r(z x ) < m. 

B. K(it) n W ^ 0. At most one of x and y Is in K('rt) . Let 

tk denote the one that is in K(Tt) and denote the other. Then * 

ft A ° 

denotes x Q or y Q respectively, and G U G denotes the highest 

ranking intersection of K(tc) with w^. Note that z^ < (£ Q ). Let w Q 
represent any w G K(it) n W. 

1. z^< (f* 0 ) does not intersect w^ because of the 

minimality condition on dL Q . Let f ^ be identical with 
^ except that /^(U^) = V where zj G w^. Then 

H i(W > p(et)h 1 (w 0 ) + r(z£) > pWh 1 (w Q ) + r(z^) = 

2. Z* - P 0 . 

There are four possibilities, depending on the choices 
at U, U, and 7. The apparent eight resulting from 
two choices at each of three information sets is reduced 
by the fact that either U ~ U or else four of the 
possibilities give K(it) n W = 0 and are treated above. 
Label the choices at U so that x G D(1,U), y G D(2,U). 
U, 2 € %y ' because of the minimality condition on 7, 
therefore the choices at U, U are completely under the 
control of player 1 and we have the sub-matrices 
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1T(U) 

h,(it) 

i 

2 

1 1 

2m+r(y 0 ) 

2m+i+r(x Q ) 

2 2 

2m+i+r(y 0 ) 

2m+r(x 0 ) 

Tf(U) 

h 2 ( ir) 

i 

2 

1 1 

2m+l+r(y 0 ) 

2m+r(y 0 ) 

2 2 

2m+r(x Q ) 

2m+l+r(x Q ) 


For any one of the four possibilities, one of the players can choose a 
strategy which will increase his pay-off. 

Note that no essential modification is needed in the preceeding 
proof if we relax the minimality condition on x Q , requiring merely that 
it is the lowest ranking position for which effectively perfect information 
later fails and belongs to an information set which intersects both w x 
and w y . 

CASE III. x Q ^ g.l.b. (x,y), U does not intersect w y . There 
is no loss of generality in assuming that for every U t if U 

intersects w y and w x , then (x,y) C U v for some V. This assumption 
is justified by the following: 

1 . There is a z € V - D(U), such that for every U G 9 
U / V, that intersects w x and w y , (x,z) C Uy for 
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some V. For assume that for every z* € V, z* ( D(U), 
there is a U G U 2 ', (x,z) $ U v for any y. By the mini¬ 
mality condition on x, U < x Q . Whence, by the minimality 
condition on x Q , TT C Uy for some V, and hence D(U) C Uy 
for some v. But then, for every z 1 * G D(5) n ?, and every 
z' GV - D(U), there is a UG]^' such that z' 1 € Uy, 
z‘ € U>j, V/ 7). Thus by Lemma 7 D(U) n V is isolated in ?, 
contrary to the hypothesis that U 1 is completely inflated. 

We can take the z thu*s proved to exist to be y. 

2. There is no U t u ^ 1 u such that U intersects 
v x and Wy and (x,y) { Uy for any v by the minimality 
conditions on x Q and x. 

3• There is no U G^', U< x Q such that U intersects w x 
and Wy and (x,y) <t Uy for any V, by the minimality 
condition on x Q . 

4. If there is a U G^', U> x Q and U intersects w x , w y , 
(x,y) <t Uy, then we have essentially Case II as noted at the 
end of the proof for that section. 

Let m and z be as in the previous cases. Let W - W u D(2,x Q ). 

Define an h as follows: 


v t W 



1 . zEP Q : h^v) - 0 

for every 1 


2. z <f P Q , z > lx Q ): 

h i (w) - Iff} 


3- z ( P Q| z > lx Q ): 

h i (w) - Iff} for 

i /1. 


h i (w ^ = pfzT for 

Z t P, 


h i (w) -Iff} for 

zf P, 

w G V 



1. h^v) - for 

every i / 1, 1 ^ : 

2 

2. 

h 1 (w) 

h 2 (w) 

w G D(2,x 0 ) 

m+1 

m 


pTV 

w G D(x,) 

m 

P(X) 

HOf 2 

57x7 

v G D(x 2 ) 

m+2 

p(x) 

pTxT 



EQUIVALENCE OP INFORMATION PATTERNS 


2^3 


w G D(y 1 ) 

m 

ply) 

m 

pTyT 

w G D(y 2 ) 

m 

ply) 

m+l 

ptyT 


Let W* - [D(2 ,x q ) u D(x) ] n D(y). We consider two cases. 

A. K(it) n w* - e. 

The argument is the same as in Case II A 1, 2(i). 

B. K(lt) n W* ^ 9. 

Here there are four cases, depending on the choice at U and 7, 
summed up in the matrices 

h 1 nr) h 2 (tt) 


\ir 2 <V) 

1 

2 

\w 2 (V) 

1 

2 




Tf,(U)\ 



1 

2m 

2m+2 

1 



2 

2m+1 

2m+1 

2 

2m 

2m+l 


and for any pair of choices, there is another choice open to one of the 
players which increases his payoff. 
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INFINITE GAMES WITH PERFECT INFORMATION 
David Gale and F. M. Stewart 

INTRODUCTION 

The notion of a game with perfect information has been defined by 
von Neumann and Morgenstern [2]. 1 The concept corresponds intuitively to 
games like checkers and chess in which the moves and positions of a player 
are known to his opponents at all times. The principal result of the theo¬ 
ry states that a finite two-person zero-sum game with perfect information 
is strictly determined, that is, that such games have a value which can be 
achieved by pure strategies. Recently Kuhn [1] has obtained a generaliza¬ 
tion of this result for n-person games which are not necessarily zero-sum. 

In this paper we consider only the two-person zero-sum case, but relax the 
condition of finiteness. Our first result shows that In this case the 
von Neumann theorem no longer holds and such games may be indeterminate. 

To illustrate this somewhat paradoxical result we consider the 
"binary game." In this game players I and II alternately choose binary 
digits 0 or 1. A play of the game consists of a countable number of 
such moves or choices. Thus each play consists of a sequence, s(0), s(1), 
s(2), ... of digits which determines the real number s = V ^ s(n)/2 n . 
Player I wins a dollar from player II if s belongs to a certain subset T 
of the unit interval, while player II wins a dollar from player I if s 
does not belong to T. It will be shown that the set T can be chosen so 
that no matter what strategy player I uses, there is a strategy by which 
player II can win, while, contrariwise, for each strategy player II may 
elect to use there is a strategy by which player I can win. 

Since infinite games in extensive form have not previously been 
considered in the literature, it is necessary to devote the first section 
of this paper to setting up definitions and notation. In the second section 
a proof is given of the general indeterminacy theorem already mentioned. 

As might be suspected this proof depends heavily on non-constructive methods 
such as well-ordering. It is therefore natural to Inquire If a game can 
still be Indeterminate if the pay-off function is "well-behaved." For ex- 


1 Numbers in brackets refer to the bibliography at the end of this paper. 
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ample In the binary game, how pathological must the set T be for the game 
to be Indeterminate? The remainder of the paper is devoted to investiga¬ 
tion of such questions, that is, under vhat circumstances is a game strict¬ 
ly determined? For this purpose we introduce in section 3 the notion of 
the natural topology of a game and the concept of subgame. Certain simple 
topological conditions are sufficient to insure strict determinacy. In 
terms of the notion of subgame we define an absolutely determined game as 
one all of whose subgames together with certain other related games are 
strictly determined. Using these concepts we are able to give the state¬ 
ments of all the positive results which have been obtained. These are 
listed at the end of section 3* As an example of these results we mention 
that the binary game is strictly determined if the set T belongs to the 
Boolean Algebra generated by the open subsets of the unit interval. In 
section 4 we give proofs of the results listed at the end of section 3- In 
the final section a number of unsolved problems are listed. As an example 
we mentioned the following open question: Is the binary game determined if 
the set T is a or an F^? 

Finally a word should be said about the reasons for considering 
games of the type described. Certainly such a game cannot be played In Its 
extensive form, but it Is hoped that the techniques used here may have 
applications to Infinite games in the normalized form. Furthermore, con¬ 
sideration of the counter example and the positive results in the infinite 
case sheds light on the von Neumann proof for finite games. Lastly, In 
certain tactical and chase problems one has a great deal, but not perfect, 
information about the opponents 1 past moves. For such problems some exten¬ 
sive form may be more useful than the normal form. We hope that this study 
of games with perfect Information may suggest methods helpful in the study 
of some games with partial information. 

4 1 . DEFINITIONS AND NOTATION 

A fundamental problem which must be faced by anyone writing on 
games in extensive form is that of finding a notation which will adequately 
represent the situation and at the same time will not be too cumbersome to 
work with. It seems traditional that everyone who works In this subject 
invents a new notation and we shall be no exception. Since we are dis¬ 
cussing only a special case of extensive games, namely two-person with per¬ 
fect information, we have chosen a representation of such games which is as 
simple as possible, and have not attempted to find a representation which 
will apply to more general cases. Also we have eliminated the possibility 
of n chance moves," Again for the sake of simplicity. What we do in this 
section is to describe a mathematical model for the games to be discussed. 
It would be possible simply to define this model and proceed to prove 
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theorems about it without further explanation. The significance of the 
results, however, lies in their interpretation as theorems about games and 
for this reason we have chosen to justify each definition by its game theo¬ 
retic interpretation as we go along. This procedure which seems essential 
to giving a clear understanding of the results, will necessitate a certain 
amount of "talk.” The reader may test his understanding of the model by 
seeing how the binary game fits into the general framework we are about to 
describe. 

A game in extensive form has been likened to a topological tree 
(see [1] and [2]). Each vertex of the tree corresponds to a particular 
"position" of the game and the branches issuing from a given vertex corre¬ 
spond to the positions which are possible on the next move. The "root" or 
initial vertex of the tree corresponds to the initial position of the game. 
Further, each vertex of the tree is assigned to player I or II according to 
whose move it is at the position in question. The first object in our 
model of a game will then be a set X, the set of positions. This set is 
partitioned into sets Xj and x n to represent the fact that at each 
position it is the move of player I or player II. 

We must next describe how the vertices of the tree are connected 
together. Given a position 2 x £ X we must give a way of telling which 
positions x' can be obtained from x on the next move. Such a position 
x* will be called an immediate successor of x, while x will be called 
the immediate predecessor of x* . A simple way of describing this situa¬ 
tion is to give a function f which carries each position, x, onto its 
immediate predecessor, 5 f(x). We must also distinguish a particular posi¬ 
tion, x Q , the initial position of the game. (Note that if x Q € Xjj, 
then player II has the first move.) Every x £ X except x Q has an im¬ 
mediate predecessor, and x Q is a (not necessarily immediate) predecessor 
of every x £ X. These properties can be assured by imposing the following 
conditions on f. 

(1.1) f maps X - x Q onto X. 

(1.2) For any xGX there is an Integer n > 0 such that f n (x) - X*. 


2 We use the standard notations, x £ X for x is a member of the set X, 

X C Y for X is a subset of Y, and X uY and X n Y for the union • 
and iHtersection of the sets X and Y. The empty set is denoted by A. 

The set of all d(x) such that s(x) is denoted by (d(x) | s(x)). The 
supremum of this set Is denoted by sup (d(x) | s(x)} or sup / xd(x). If 
f Is a function f|X is its restriction to the set X. v ; 

5 We are assuming that each position has a unique immediate predecessor. In 
an actual game, say chess, one knows that the same disposition of the pieces 
can be arrived at by different successions of moves. This difficulty can be 
avoided if we consider a position as consisting not only of the arrangement 
of the pieces, but also of all previous arrangements. 
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Now x Is a predecessor of y and y is a successor of x if 
for some integer n > o, x « f n (y). If n - 1, x is the immediate prede¬ 
cessor of y and y is an immediate successor of x. 

The game is now played as follows. According as x Q is In Xj 
or X n player I or II picks a position x 1 t f" 1 ^) (note that f" 1 (x Q ) 
is the set of immediate successors of x Q ). In general if n positions 
have been chosen, then according 1 * as x n belongs to Xj or X II player I 
or II chooses a point x n+1 £ f*" 1 ^). In thls way a se( l uence of * points 
(x n ) is chosen by the two players. Such a sequence is called a play of 
the game. 

More precisely a sequence, s(0), s(l), ..., is a play of the 

game if 

(1 -3) s(o) - x Q , 
and 

(1.4) For any I > 0, s(i) = l* (s( i + 1 )) . 

The set of all plays is called the space of the p;ame and will 
usually be denoted by S. 

To complete the description of the game it is only necessary to 
give a pay-off function , that is, a real valued function on the set S. 

If the players play so that outcome is s then player II pays player I an 
amount $(s) units. Most of our results are for the special case where $ 
is the characteristic function of a set Sj which will be called the 
winning set for player i; s n = S - Sj will be called the winning; set for 

Player II . A play s of the game is a win for player I or player II ac¬ 
cording as s t Sj or s £ Sjj. 

To summarize 

DEFINITION 1. A game P is a collection of 
objects (x Q , Xj, Xjj, X, f, S, 1?) , such that 
0.5) x Q C X, 

( 1 . 6 ) x i n x n = A > x i u x n = x » 

(1-7) f is a function satisfying (i.i) and 

( 1 . 2 ), 

(1.8) S is the set of all sequences satisfying 

, (1 .3) and (1.4), 

( 1 . 9 ) 5 is a real valued function on S. 


**In most games the players move alternately. We shall no.t require this 
since its only result would be to complicate the notation. 
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DEFINITION 2. A win-lose game j 1 is a collection 
of objects (Xq, Xj, f> S, Sj, S jj- ) such that 

( 1 . 5 ) - (l * 8 ) and. 

(,., 0 ) s x n 3 n = A SjOSjj-s. 

A play of P is an element of S. It is a win 
for player I (player II) if it belongs to Sj (Sjj)• 

The above description completely defines the rules of the game. 

In order to discuss questions of aeterminacy it is now necessary to define 
the fundamental notion of a strategy. A strategy here is clearly a rule 
which in any position will tell a player what his next move shall be. 

DEFINITION 3. If n = (x Q , Xj, X^, X, f, S, $) 
is a game, the set, ^(P), of strategies for player I 
consists of all functions, <r, with domain X^ such 
that 

(1.11) <r(x) 6 f-’(x). 

The set, ^jj(P), of strategies for player II consists 
of all functions T on Xjj satisfying 

(1.12) T(x) 6 f" 1 (x) . 

Now to every pair of strategies <r ana *r will correspond a 
unique play s of the game P. This play which we write as s = <<r,T> is 
the play which results if the two players pick the strategies r and T 
respectively, and will satisfy the following inductive definition. 


( 1 . 13 ) s( 0 ) - x Q . 

(1.14) If s(n) £ Xj then s(n + 1) =<r(s(n)) ; 
if s(n) £ Xjj then s(n+ 1) = Tts(n)) . 

We may now consider the pay-off function, $, as defined on 
pairs of strategies, as is usual in game theory. That is 5 (^",t) « 

$K r , r y) * The definitions of strict determinacy and of the value of a game 
now follow in the usual manner, ([ 2 ] p. 106 ) since we have now succeeded in 
putting the game in the normalized form. Thus P is said to be strictly 
determined and have value v if, 

“tsSuIP) s ^«r6v l( r) lnf Tcv Il( P) - v 

As usual with infinite games, we require only the equality of infima and 
supreme rather than that of maxima and minima. 
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A win-lose gam© P - (x Q , Xj, X XI , X, f, 3 , Sp Sjj) is 
equivalent to the game with pay-off, P* - (x Q , Xj, X IX , X, f, S, 3 &) 
where $ is the characteristic function of Sj. If P' has a value then, 
since & can assume only the values o and 1 , there is a r Q t Sjd 1 ) 
and a T 0 G SjjtP) such that sup^v^p) $ ( <r > T 0 ) * 
inf T€ ^^ (p j S (<r 0 ,r) « ^q^o* " v - The value, v, is l, and <r Q 

always wins $ for player I if and only if for all T6 S n (H, 

<<r 0 ,T> € Sj. Similarly v is zero and t q always wins for player II if 
and only if <«", 7 ^> G Sjj for all r £ 2 }j(P) • 

DEFINITION 4 . If P - (x Q , Xj, Xjj, X, f, S, Sj, 
s IX ) is a win ’ lose s 81116 then the s ®t, Si (P)> (or 

Sii (P)) °? winning strategies for player I (or 

player II) consists of all <r G Sj(P) (or 
T G Sjj(P) ) such that 

( 1 . 15 ) r G S IX (P) implies <<r,T> £ S x 

(or 

(1.16) <r g Sj(P) implies <<r,r> G S IJ: .) 

DEFINITION 5 . A vin-lose game P is strictly 
determined if Xj (P) ^ A or Xji ^ ^ ^ * 

$ 2 . THE INDETERMINACY THEOREM 

We now construct an example of a an Infinite game with perfect 
information which is not strictly determined. 

At each turn the possible moves are i) choose the digit o and 
ii) choose the digit 1 . Thus X, the set of positions, consists of all 
finite sequences (a(l), a( 2 ), a(n)} where each a(i) is either 0 

or 1 . The initial position x Q is the sequence of length zero. A 
position (a(l), ..., a(n)} is in Xj if n is even, and in Xjj if n 
is odd. 

At each move a player cannot change the previous moves so 
f((a(i), ..., a(n))) - (a(i), ..., a(n - U). 

. The set, S, of plays consists of all infinite sequences of the 
form Cx Q , (a( 1 )), (a(i), a( 2 )}, (a(i), a( 2 ), a( 3 )), ... ). 

We now construct subsets Sj and Sjj of S such that the 
win-lose game P» (x Q , Xj, Xjj, X, f, S, Sj, Sjj) is not strictly deter¬ 
mined. 

The construction is'based on two facts. 

A. The number of strategies in 5 }j(P)> (and in 
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2 n (P)) 18 2 V °. 

B. For each t q £ Sjj(D the number of plays in 
S T = K^T^Io- £ £j(P)) is 2 °. Similarly for each 

<r 0 °6 2 I (H, s,,. - «<r 0 ,T>|T 6 2 n (P)) has 2 *° 
members. 0 


PROOF OF A. Each function e on Xj to the set whose members 
are 0 and 1 determines and is determined by a strategy, <r 0 £ 2j(P) 
where <r Q ({a(l), a(n))) = (a(l), .... a(n), e({a(l), ..., a(n)))). 

Since Xj has elements there are 2 0 such functions and 2 0 

strategies. ^ 

PROOF OF B. There are 2 0 infinite sequences (d.(o), <*(l), ••• 
where <t(i) is o or 1 . Corresponding to each such sequence there is a 
play s defined inductively by: i) s(0) = x Q ; ii) if s(2n) = 

(a(l), ... a(2n)} then s(2n + 1) = (a(l), ... a(2n), d(n)); iii) s(2n) = 

r o (s(2n - 1)). Distinct sequences determine distinct plays. 

For each such play, s, there is a (not unique) strategy <r 
such that <<r,r o > = s. E.g., let <r(s(2n)) = s(2n + l) and <r(x) is 
arbitrary if x £ Xj but x ^ s(n) for any n. 

Thus there are at least 2 0 elements in q ^^(P)}. 

Since S ^itself has only 2 °, S r = (<<»“, r o >j<T£ 2Jj(P)) must have 
exactly 2 ° elements. u 

The proof for S^ is similar, 
o 

We proceed to the construction of Sj and Sjj. 

Let <*- be the least ordinal such that there are 2 ° ordinals 

less than <*,. By A we can index the strategies in 2j(P) as ffjjj, 
fl £ U|# < d). Similarly we can index the strategies in £jj(P) as T , 
ft 6 (»|* <<*•). * 


Choose 
If 


s o e S r 


Choose 


6 s - 0 


have been chosen for all 


inductively . xx o y , L#y UO.VC7 UCCU UliUOC 

(ty|* < 0) has fewer than 2^° members 
Choose one of its elements and call it s 


so 


so that t Q ^ s Q . Proceed 

* < fi < the set 

is not empty 


y 


Similarly 


tt y |l < fi) 


(s y |V ifi) 


is not empty. Call one of its members t^. 

We now define ACS by the rule A 
by the rule B « (ty|lf < <i), and we assert that the sets A 


(Syhr < *), 


and 

and 


B C S 
B are 


disjoint, i.e., for any t and /3, 
CASE I. If I < /S then 


tp f {s^|«f < y and therefore t^ ^ s y 


s if ^ t fi’ 
t fl 6 3 _ 

* ^ 


(S rf |<f £ fi) 30 


By t Itjltf < V) 


CASE II. If If > p then 
and therefore 


a * * V 


f t3 r • 


SO 
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We now partition S into two sets Sj and Sjj in any manner 
provided only that A C Sj and B C Sjj. To show that the game so defined 
is not strictly determined it suffices to show that 0"*) " (D *= A, 

(see DEP. 5). Let r be in X j(P) • Then <r corresponds to some index, 
say fi* By construction there exists a play t^ such that tg G 3^ and 

hence there exists TG Xjj(H) such that <0^/0 = V e B c s ir Thus 
fljl ( Xx (P) snd hence Xz tP) “A* Symmetrically one shows that 
X^xx ^ “A and hence the theorem is proved. 

Thus P is not strictly determined and we have 

THEOREM 1. There is an infinite game with perfect 
information which is not strictly determined. 

$ 3. THE TOPOLOGY OP INFINITE GAMES 

Our positive results about strictly determined games are most 
easily stated in terms of a natural topology on the set, S, of all plays. 
Each play is a function from the non-negative integers to the set, X, of 
positions. The topology imposed on S turns out to be that of pointwise 
convergence of the functions if X is given a discrete topology. 

Throughout this section we will give most of our attention to 
win-lose games, but the definitions and results are equally applicable, 
mutatis mutandis, to games with pay-off. 

NOTATION. If P* (x Q , Xj, Xjp X, f, S, Sp Sp.) 

Is a game and x G X then 

*U(x) = (s| s G S and, for some i, s(i) = x) . 

One easily verifies that the i is the same for all s G 71(x) 
and is the integer i such that f^x) = x Q . 

DEFINITION 6. If P - (x Q , Xp Xp, X, f, S, Sp 
Bn) Is a game and s G S, a neighborhood of s is 
any Vix) containing s. 

Note that *u(x) is a neighborhood of s if and only if x » s(i) 
for some integer i > o. 

THEOREM 2 . If P - (x 0 , Xp Xp, X, f, 3, Sp Sp) 
is a game the neighborhoods of points of 3 determine 
a Hausdorff topology for 3. In this topology 3 Is 
totally disconnected. 
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The proof Is a routine matter of verification. We will wish, 
however, to refer to the following facts. 

( 5 . 1 ) If f^x) - y then U(x) C U(y) 

( 3 - 2 ) If, for every i > 0 , neither f^x) = y nor f^y) = x 

then H(x) n U(y) = A . 

r 

We shall call a win-lose game P open or closed according as 
the set Sj is open or closed. 

It is desirable to be able to consider finite games with perfect 
information as a special case of infinite games. There is a slight dif¬ 
ficulty in doing this since by our definition of a game each play involves 
an infinite number of moves. This can be gotten around, however, by 
Introducing "dummy" moves, that Is, positions such that the player whose 
move It is has only one alternative. Such a position shall be called 
ineffective . In terms of our notation the position x is ineffective If 
f” 1 (x) contains only one element. Thus chess may be considered an in¬ 
finite game by making all positions which are successors of a checkmate or 
stalemate Ineffective. 

Consider now the following three finiteness conditions. 

DEFINITION 7. An infinite game P (x Q , Xj, X I]C , 

X, f, S, $) satisfies condition F.1, or F.2, or F-3 If, 

respectively, 

(F.1) X contains only a finite number of effective 
positions; 

(F.2) there Is an N such that for all s G S, n > N 
implies s(n) is ineffective; 

(F-3) For every s G S only a finite number of the 
s(n), n = 0, 1 , ..., are effective. 

Note that (F.l) implies (F.2) and (F.2) implies 

(F-3)- 

We now state a result connecting the notion of finiteness with 
the topology of a game. The proof is straight forward and we omit it. 

THEOREM 3 • The game P satisfies the condition 

(F. 3 ) If and only if the space of P is discrete. 

Von Neumann has proved [2, pp. 112 - 128 ] that finite games with 
perfect information are strictly determined. His methods — in particular 
section 15*8 — can be extended to show that every game satisfying (F. 3 ) is 
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strictly determined. However, this result turns out, in view of Theorem 3 , 
to be just a special case of our Theorem There need not, however, be 
a strategy which ensures the achievement of the value. This situation is 
clarified by Theorem 1 6 . 

Another concept intimately related to the topology of a game is 
that of a subgame. 

DEFINITION 8 . A win-lose game P» * (x Q ', Xj', 

Xn', X', f *, S', Sj*, Sjj') is a subgame of 


r = (x 0 . 

^I» ^n» 

S, Sj, Sjj) 

if 

( 3 . 3 ) 

x o’ “ x o 



(3A) 

Xj' C Xj, Xjj’ 

C Xjj 


(3.5) 

f* = f|X' 



(3-6) 

Sj’ = Sj f) S', 

S Il' “ S II 

n s» . 

For 

games with pay- 

•off ( 3 . 6 ) is 

replaced by 

(3-7) 

36' - fis* . 




Intuitively a subgame Is obtained by adding new rules forbidding 
certain moves. E.g., if two chess players agree to use a particular 
opening, they play a subgame of chess rather than chess Itself. 

The connection between subgames and the topology is embodied In 
the following two theorems whose proofs will be found in section 4. 

THEOREM k. If n» - (x 0 ‘, Xj', Xjj', X*, f», S', 

Sjj') is a subgame of P * (x Q , Xj, Xjj, X, f, S, Sj, 

Sn) then S' Is a closed, non-empty subset of S. 

THEOREM 5 • If r - (x Q , Xj, Xjj, X, f, S, Sj, Sjj) 

Is a game and F is a closed non-empty subset of S 
then there is a unique sub game of p whose space is F 
with its relative topology as a subset of S. 

NOTATION. If F is a closed, non-empty subset of 
S then the corresponding subgame of P will be denoted 
by r p , and x£, X^j, X^, t*, S P , S p , Sjj will denote 
the objects such that P p - (x Q , Xj, Xjj, X?, f F , S P , 

S P , Sjj) . If F is a neighborhood "U(x) we will 
use P x , Xj, etc. instead of P-y( x ), Xj^ x *, etc. 

We now define certain simple set theoretic operations on games. 

DEFINITION 9. If P - (x Q , Xj, Xjj, X, f, 3, Sj, 

Sjj) and “ (Xq, Xj, Xjj, X, f, 3, 3j', Sjj’) then 
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we define the Intersection of P and p« by 
rnr> - (x Q , Xj, X rl> X, f, S, Sj OSj', 3 - (SjrtSj.*)) 
and the union of P and p* by 

TUP 1 - (x 0 , Xj, X n , X, f, 3, Sj yj Sj*, 3 - (Sj O Sj')) • 

Note that unions and intersections can only be defined for pairs 
of games having the same x Q , Xj, Xjp X and f. 

DEFINITION 10. We define the negative of the game 
r = <V x i> x n> x ' s ' s i' s n ) to be the game 
- P = (x Q , Xj, X n , X, f, S, Sjj, Sj). 

In section 5 we give examples to show that the unions, inter¬ 
sections, and negatives of strictly determined games need not be strictly 
determined. Accordingly one is led to consider the following stronger 
condition of determinacy for a game. 

DEFINITION 11. A win-lose game P is absolutely 
determined if all subgames of T and - P are strictly 
determined. 

We are now in a position to state our remaining results. The 
proofs of most of them will be given in the next section. 

THEOREM 6. The union of an open game and an 
absolutely determined game is strictly determined. 

COROLLARY 7- An open or closed game is strictly 
determined. 

COROLLARY 8. A discrete game is strictly deter¬ 
mined . 

COROLLARY 9« The intersection of a closed game and 
an absolutely determined game is strictly determined. 

COROLLARY 10. An open or closed game is absolutely 
determined. 


THEOREM l1. The Intersection of an open game with 
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an absolutely determined game Is strictly determined. 

COROLLARY 12 .' The union of a closed game with an 
absolutely determined game is strictly determined. 

COROLLARY 1 3• The union and Intersection of an 
open or closed game with an absolutely determined game 
are absolutely determined. 

THEOREM 14. If P - (x Q , X p Xjj, X, f, S, Sj, S n ) 
and Sj belongs' to the BColean algebra generated by 
the open sets then P is absolutely determined. 

THEOREM 15- If P - (x Q , Xj, Xjj, X, f, S, $) is 
a game with pay-off and § is continuous then P is 
strictly determinea. 

THEOREM 16 . If P = (x Q , Xj, X n , X, f, S, i) is 
a game with pay-off the following three conditions are 
equivalent s 

i) For every x £ X, f“ ] (x) is a finite set. 

ii) S is compact. 

iii) For every continuous pa^-off function IF on 
S the value, v‘, of P* - (x Q , X Jf X n , X, 
f, S, H) can be achieved. (I.e., there is a 
<T 0 £ SjCT') and a t q £ such that 

8 ' 5 Vr«2 I (P*) Y(<r * T o> ) -* r o< T ol - v '- 

4 4. PROOFS 

This section consists of the proofs of Propositions 4 through 16 . 
PROOF OF THEOREM 4. Since P' is a game. S' cannot be empty. 
Let s be any element of S - S'. For some n, s(n) $ X' since S' is 
the set of all sequences satisfying (1.5) and (1.4) with f' «= f|X’ in 
place of f. Now if t G K(s(n)) then t(n) - s(n) (X* so S - S> 

contains a neighborhood of s. Thus S - S' is open and S’ is closed. 

PROOF OF THEOREM 5 • Let X P =(x|xGX and U(x)OF/A), 

Xj » Xj A X P , X^J * Xjj A X F , f * 1 * fix?, S F - F, S F = Sj A F, S F j « Sjj A F, 

and P p - (x Q , X?, X^j, X*. t*, S p , S P , S P j). Since (3.5) - (3-7) are 

obviously satisfied, P p is a subgame of P if T p is a game. We proceed 
therefore to verify that P p satisfies ( 1 . 5 ) -( 1 . 9 ). 
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Clearly (1.5) and ( 1 . 6 ) are satisfied. 

Now (i.l) and f 5 * = flX^ entail (1.2) so (1.7) depends only on 
verifying (1.1) for f^. Since U(x) <^U(f(x)) the range of is 

contained in /. By definition, if x G X F then there is an s G F and 
an integer n > 0 such that x =* s(n) . But s G U(s(n + 1 )) so 
s(n + 1) G X P and x = s(n) = f(s(n + 1)) = f F (s(n +1)) so the range 
of cbntains X^. 

As above If s G F then s(1) G X F for every integer 1 > 0 . 
Thus ( 1 . 5 ) and (1 .4) hold for every s G F. Hence to establish (1.8) we 
need only show that every sequence, s, satisfying ( 1 . 3 ) and (1.4) belongs 
to F. If s(o) = x Q and s(i - 1 ) = f^(s(i)) 'then s(i) G X F . Hence 
every neighborhood, U(s(i)), of s contains points of F. Since F is 
closed, s G F. 

Condition (1 .9) is clearly satisfied. 

Thus FL is a subgame. We now show that it is unique by 

-Fii» 11 

assuming that P* = (x 0 , Xj, X n , X’, f', P, Sj, Sjj) is a subgame and 
proving P* = P F - 

By (3•3), x q = x Q . 

If x £ X' then by (1 . 1 ) there is an n such that f' n (x) = x . 

t „ A U 


Set 

8(1) = f ,n_1 (x) 

for 

0 < i < n. Since f 

is onto (i. 

•e., (1.1)) we 

can. 

by Induction, define 

s(i) for i - n + 1, 

i n + 2, ... 

so that 

s(i) 

= f'(s(i + 1))• 

By (i 

1.8), s G F. Since 

s G *U(s(n)) 

«U(x) it 

follows that x G X • 






Conversely 

if x 

G X F then, for some 

s G F and 

some integer 


n > 0, x = s(n) . Using (1 .8) and (1.4) s(i) G X' for all i, and in 
particular x = s(n) G X'. Thus X F C X'. 

Hence X F = X 1 and, by (1.6), (3-4) and the definitions of 
Xj and Xjj, Xj = xj and Xjj = xjj. 

From (3•5) and (3•6), f 1 = fix* and Sj = Sj A F and 
Sji - Sjj A F which completes the proof. 

In the following proofs we need to know something of the rela¬ 
tionship between strategies in a game and those in its subgames. If 
P' = (x Q , Xj, Xjj, f'. S’, Sj, Sjj) is a subgame of P a strategy 
O' G ^j(P) is an extension of o’* £ Sj(P') 

(4.1) <T* = <r|Xj . 

Extensions of T* t SjjfP') are defined similarly. Clearly every strate¬ 
gy for a subgame has an extension which is a strategy for the original game. 

LEMMA 4.1. If 

(4.2) P 1 = (X Q , Xj, Xjj, X', f'. S', Sj, Sjj) iS & 
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subgame of P 

(4.3) <r G Si(H is an extension of <P G Sj(P') 

(4.4) Tc2 n (P) 

(4.5) <<r, T> G 3* 

then there is a T* G 2 ij(P*) such that * 

<<r,r>. 

PROOF. Let <<r,T> - s. By (4.5), (1.4), and (3-5) s(i) G X* 
for all i. Let T'(s(i)) - s(i + 1) if s(i) G xjj, and let T»(x) be 
any element of f'^fx) if x t Xjj and x ^ s(i) for each i. Let 
8 , -<<r',T*>. If s(l) - s'(i) G Xj. then by (4.1) and (4.3) s(i+l)= 
<r(s(i)) « r>(8«(l)) = s 1 (i + 1). If s(i) - s'(i) G Xjj then s(i + i) « 
T(s(i)) » s»(i + 1). Since s(o) « x Q = s' (o) we have s *» s' by in¬ 
duction. 

LEMMA 4.2. If T » (x Q , Xj, X n , X, f, S, Sj, Sjj) 
is a game; Y C X; for each y G Y, there is a 
r y G Sj(Py) # and **0 G £j(P) then there is a 
f G 2j(P) such that for each T G Sjj(P) either 

(4.6) <cr,7> - <o- q ,t> ( U yGy U(y) 
or 

(4.7) For some y G Y and some T G ^ n (r y ), 

<<r,i> = <<r y ,r y >. 

PROOF. If z is a successor of some y G Y let 4>(z) be the 
"last" predecessor of z in Y. I.e., <|)(z) = f n ^ (z) where 

n(z) - sup (ilf^-fz) G Y). Let 

{ <r Q (x) if x G Xj and, for all i > 0, f*(x) ( Y 

^ (x) (x) if x G Xj and, for some i £ 0, f^x) G Y. 

If TG S XI (P) let s =<<t,t>. 

If s G t/y^yUfy) then there is a least integer n such that 

s(n) G Y. For x « f L {s(n)) » s(n - i) G Xj, i - 0, 1, ..., n, 

<r(x) « s(n - i + 1) - *^ n )(x) so o- is an extension of ^ s ( n ) • By 
Lemma 4.1 there is a T g(n) 6 S^Pg^)) such that <«r,r> = <<r 8(n) ,r (n) >. 

If s $ VJ^Y^ty) then s(i) f Y for each 1. Hence if 
s(i) e Xj, s(i + i) - r(s(l)) = <r 0 (s(l)) so <r,T> - <o* 0 ,t>. 

LEMMA. 4.3- If P' is a subgame of P, r C 2)j(P) 
is an extension of <r' 6 2j(P')» and T 6 2u<P) is 
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an extension of T' £ 2j].(P') then <o-,r> = T’>. 

PROOF. Let s ■= <«*,T>, s' -<o",T'>. By (3-5) and ( 1 . 3 ), 
s(o) - s'(0). If s(i) - s'(l) £ Xj, then, by (3-5), s(i + 1 ) - <r(s(i)) « 
ar'(s'd)) - s’(i + 1 ). Similarly if s(i) - s'd) £ X XI then s(i + 1 ) = 
T(s(i)) - T’(s'(i)) - s'(i + 1 ). In either case s(i + 1 ) = s'(i + 1). 
Hence by induction s(i) = s'd) for all i, or s = s'. 

LEMMA if.U. If P - (x Q , X x , X I3; , X, f, S, Sj, S IX ) 

is a game, f(x) £ Xj, and (P x ) is not empty then 

Xi (P f(x) ) is not empty. 

PROOF. It is clear that P x is a subgame of Pf( x )• If 
r ' 6 (P x ) let * € 2j(Pf( x )) be an extension of <r’ • If 
T £ 2u(f’f( x )) then, since f(x) £ Xj, T* - T|X XI £ S n (P x ) • By Lemma 

*».3, <<r,T> = <<r' ,r’> £ Sj because <r' £ Xz (P x ) • Thus <r £ (r f(x) ). 

LEMMA 4.5- If P- (x Q , Xj, X IX , X, f, S, Sj, S^) 

Is a game and if x G X, such that f(y) = x inplies 
Sj (P y ) is not empty, then X^x (P x ) Is not empty. 

PROOF. If x G Xj then (P x ) is not empty by Lemma 4.4. 

If x G Xjj let Y = f” 1 (x). For each y G Y choose 
°“y £ Xj (Py) • Let <r o be any element of 2j(P) • Let r be a strategy 
determined from Y, <r <r according to Lemma 4.2. Since U cv *U(y) ** S x , 

ye - ytJL 

(4.6) can never hold. Thus for any T, and some y G f (x), <(T,T> = 
where Ty G Xjj(Py) • Since cr^ G (Py) > G Sj. 

To avoid unnecessary repetition we do not prove the dual lemmas 
with the roles of the players interchanged. 

PROOF OF THEOREM 6. Let G be open in S and let P be 
absolutely determined. We shall show that 

r- - (v x r x n« x ’ s ' S I u G ' s n - 0) 

is strictly determined. 

Let 


P * = (x o* X I' X II' x ’ f » S ’ G, S - G) , 

Wj - (x|V]j! <P*> 13 not eiapty) , 

F “ S - U x£V^<*> • 
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If 'U(x) C G then ©very or G 2Jj(P x ) will win for player Ii so x G Wj. 
Since G is open it is the union of all neighborhoods contained in it. 
Hence 

(4.8) G c ^xGWJ 11 * 30 * 

If x. G Wj then any (TG (^v ) will, a fortiori, win P* . 

° * ± X ° 

If x Q ( Wj then, by induction using Lemmas 4.4 and 4.5, there 

is an s G S such that s(i) ( Wj for each i. Accordingly s C* F, so 

F is not void and determines a subgame, P F , of T. 

Since P is absolutely determined it remains only to show 
A: If 2j(P p ) then (T*) ^ A. and 

B: If 2ii OV / A then (r«) / A- 

PROOF OF A. For each x £ W* choose <r x 6 V“ (P*). Choose 

<T| £ 2 1 (Pp) and let r Q be any extension of . By Lemma k.2 there 
is a o“ G 2)j(D such that for each T G £jj(P) either 

(4.9) <<r,t> - <<r o ,T> G F 
or 

(4.10) For some x G Wj, and some T x G 

<*\t> = <<r x ,r x > . 

If (4.9) obtains then, by Lemma 4.1, there Is a T 1 G SjjO"p) 
such that <<r,r> = <<r Q ,T> = Because <r, G Xj «V, <<T,T> G Sj. 

If (4.10) obtains then, since <r x G (P*), <^,T> G G- 
In either case <<r,T> G Sj o G so <r £ (P') . 

PROOF OF B. Choose £ Vjj (P p ) • Choose T(x) - T F (x) if 

x G Xjj ; T*(x) is any element of f" 1 (x) - Wj if such exist. If x Is 
any other element of Xjj then T(x) is any element of f** 1 (x). Let o~ 
be any element of Sj(P'). If <G",T> G F then by Lemma 4.1 and the fact 
that 

T F € Sii ( P F } ' <^ r > G F - Sj - S - U xGW jH(x) - Sj C S n - 0 . 

If <<T,T> = s t F, then there would be a least Integer n > 0 
such that s(n) G Wj. By Lemma 4.4 s(n - 1) = f(s(n)) ( Xj. But If 

S(n - 1 ) 6 Xjj - Wj then by Lemma 4.5 there would be a 
y G f^tsfn - l)) - Wj. Accordingly, by the definition of T, 
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s(n) - T(s(n - 1)) £ f-^sCn - 1)) - Wj, which is inpossible. 

Thus for every <r, <<r,f> t Sjj - G. 

PROOF OF COROLLARY 7• Apply Theorem 6 to the special case where 
the absolutely determined game is P - (x Q , Xj, Xjj, X, f, S, A, S). This 
proves the corollary for open games. If P - (x Q , Xj, Xjj, X, f, S, Sj, Sjj) 
is closed then P* = (x Q , Xjj, Xj, X, f, S, Sjj, Sj) is open. The corol¬ 
lary then follows from the obvious 1-1 correspondences between ^j(P') 

and Xjj(P) and between £jj(P') and Sj(P) which maps winning strate¬ 
gies onto winning strategies. 

PROOF OF COROLLARY 8. In a discrete game every set Sj C S is 
open. Hence by Corollary 7, a discrete game is strictly determined. 

PROOF OF COROLLARY 9- Let P = (x Q , Xj, X jr X, f, S, Sj, Sjj) 

be absolutely determined and let F be a closed subset of S. We must 

show that P* = (x Q , Xj, Xjj, f, S, Sj A F, S - (Sj A F)) is strictly 
determined. 

Consider the game 

P'' = (x 0 , X ir Xj, X, f, S, S - (Sj A F), S x A F) 

and note that S - (Sj A F) - Sjj u (S - F). Since P is absolutely 

determined P'* is by Theorem 6 strictly determined, ana reversing the 
roles of the two players again shows that so is p 1 . 

PROOF OF COROLLARY 10. Let Sj C S be open. If 

Hp = (x 0 , x F , x F x , y?, fh s F - f, Sj a f, s n n f) is the subgame of P 

determined by the closed subset F then the topology of S^ is just the 
relative topology of F as a subset of S. By the previous corollaries 
Pp and - Pp = (x Q , X F , X F j, X F , l^, S F , Sjj n F, Sj n F) are strictly 
determined. 

PROOF OF THEOREM 11 . Let P = (x 0 , Xj, Xjj, X, f, S, Sj, S n ) 
be absolutely determined and let G be an open set in S. We must show 
that (x Q , Xj, Xjj, f, S, Sj A G, S - (Sj AG)) . is strictly determined. 

Let 

Y- (x|U(x) C G and V* (P x ) jt A) 

Z = (xfU(x) C G and i}jj (P x ) / A) . 

For y C Y choose <r y 6 j (P^) • For z 6 Z choose T z £ jj (P z ). Let 
r* = (x Q , Xj, Xjj, X, £', S, U^Htx), S - By Corollary 7 P* 

is strictly determined. 

CASE A: (p*) jt A. 

Choose 6 ^j(P*) and determine a strategy using Y, T , 
and <r Q as in Lemma 4.2. 
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Let T be any element of 2 jj(D • Since <cr 0 ,T> £^ xC yU(x), 
(4.6) cannot obtain. Hence for some y £ Y and some T y £ 

<<f,T> - <<r,T y >. Since o- y 6 £j (Ty). <°"y' T y> 6 Sj nU(y) C Sj fl O. Thus 

<T 6 2j(r')- 

CASE B: 2n <P*> / A- 

Choose t q G X ii (P*) • We can Q-PPiy the dual of Lenima 4.2 
to the set Z, the strategies T z , z £ Z, and T Q to determine a 
T £ Sjjd 1 ') such that for any o“ £ Sj(P’) either 

(4.11) <cr,T> * <<r,r o > <£ 
or 

(4.12) for some z G Z and some <r z 6 £j(P z ), <<r,T> = < <r z> T z > • 

If (4.11) obtains then, since T 0 G £ jj (P*), <<r,T> = 

<0",^ t L^ CY "W(y) • Using this and (4.11), <<r,r> g S - 

Since P is absolutely determined and G is open, 

S - V yGY aWy) - b/ cz U(z) - S - S«x)CG U(x) - 3 - 0 c S - (Sj h G) . 

If (4.12) obtains then, since T z G Vjj (P z ). <«",T> = 

<«r z ,T z > CSjj-S-SjCS - (SjrtG). 

In either case T defeats <r, so T G Sjj (P')• 

The proof of Corollary 12 is like that of Corollary 9. 

PROOF OF COROLLARY 13 . Let r - (x Q , Xj, Xjj, X, f, 3, Sj, Sjj) 
be absolutely determined and let T be an open subset of S. We must show 
that (x Q , Xj, Xjj, f, S, Sj u T, Sjj - T) and 

(x Q , Xj, Xjj, f, S, Sj A T, S - (Sj AT)) are absolutely determined. 

Let F be a closed subset of S. Now (Sj u T) A F - 
(Sj A F) u (T A F) and (Sjj - T) A F - (Sjj n F) n ((S - T) A F) . Since 
the topology in S F = F is its relative topology as a subset of S, 

(x 0 , X P , fP, S P , (Sj uT) AF, (Sjj - T) n F) and 

(x 0 , X*, X?j!j, xP, fP, S P , (Sjj - T) A P, (Sj UT) A P), are, by Proposi- 

tions 6, 9, 11, and 12, strictly determined. I.e., 

(Xq, Xj, Xjj, X, f, S, Sj u T, Sjj " T) is absolutely determined. 

We omit the proof for (x Q , Xj, Xjj, X, f, S, Sj A T, S - (Sj 0 T) 
PROOF OF THEOREM 14. Because the topology of the space of a 
subgame is the relative topology it will suffice to show that P is 
strictly determined. 

Every element of the Boolean algebra generated by the open sets 
belongs to a Boolean algebra generated by n particular open sets. We 
assume that the theorem is true if Sj belongs to a Boolean algebra 
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generated by n open sets and prove that it then holds with n replaced 
by n + 1 . Corollary 1 3 ensures that it is true for n - 1 . 

We assume that Sj belongs to the Boolean algebra generated by 
the open sets G 1 , ..., G n+1 * We give the proof for the case 

(4.13) gJ n ... OG^ C Sjj (G^ here denotes S - G 1 ) . 

The proof for the contrary case, gJ n ... n G^ +1 C Sj is obtained by 
interchanging the roles of the players. 

Let Y = (yFU(y) C G^ for some i and (Py) / A ), 

Z = (z|U(z) C G 1 for some i and Xji (P z ) ^ A) . For each y G Y 

choose o-y G X j (Py) 6111(1 for each z G Z choose T z G (P z ) • 

If U(x) C G 1 for some i then s j * s j A U(x) C Sj n G^. Thus 

Sj belongs to the Boolean algebra generated by G 1 nU(x), ..., 

G i-1 G i + 1 ^ U(x), •••> G n+ i nU ( x )* By the inductive hypothesis 

P x is strictly determined so x G Y UZ and, using (4.13) 

(*•1*0 Sj. C 0, u ... oG ri+1 - ^ yGY U(y) u U ztz U(z) • 

By Corollary 10 , P* = (x Q , Xj, Xjj, X, f, S, LJ yGY U(y), 

3 - U Y rJAW ) is strictly determined. We thus have two cases to consider. 
CASE A: (p) / A- 

Choose cr Q G (P') and let <r be determined from Y, 0 ^, 
and G~ 0 according to Lemma 4.2. Let T be any element of Xjj(P) • 

Since <r o G Vj (P‘), (4.6) cannot hold. Thus from (4.7) there 
is a y G Y and a T y G such that = ^^y^y^’ Since 

(P y ), <<r,T> G Sj nlKy) C Sj and (TG vj (P) . 

CASE B: Xjj (P 1 ) 7* A- 

Choose T G Xtt (P 1 ) and let T be determined from Z, T_, 
and T q according to the dual of Lemma 4.2. If «TG ^j(P) then either 

(**•15) < r ,T> = < <r . V ( ^^(z) , 

or 

(4.16) for some z G Z and some c r z G ij(P z ), * 

If (4.15) holds then, since T Q G (P'), <<**,!> ( ^ycy^?) * 

Combining this with ( 4 . 15 ) we see by (4.14) that <<*'',t> £ Sj. 

If (4.16) obtains then, since <r z G (P z ), <<T,r> G SjjA^Kz). 

In either case <<r,T> G Sjj so TG (P) • 

PROOF OF THEOREM 15- Let S^ - (s|s G S, *(s) > ol). Since * 
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is continuous - (x Q , Xp Xjj, X, f, S, S A , S - S*) is strictly 

determined. Let v - sup (<i| Xj (I*) 7 * A) . If v 1 < v then there is an 

ol, v 1 < di such that (P^) is not void. Choose <r Q G (P^) C 2Jj(P) ■ 

If T G Sn(P) - XjjlPJ then <<r,r> € so 5>«<r o ,r» > * > Vl . 

Thus 5( < <r o ,r ^ > ) ^ ^TGjjjtP) *« r o ,T ^) - V 1 ’ 

Similarly if v 2 > v then there is an cL < v 2 such that 
X jj (P^) is not void. There is, as before, a T Q such that 

lDf «Sii (r) SUP<r6 Sl( p ) t(<<r ' T>) < ""rsJjtP) *« ,r ' r o> ) <*< v 2 - 
Since 3up ff . c ^^ (p) inf T6Sii(r) < 

inf^ Jjj(P) 3U ^GXj^ *« <r > T » for ^ it follows that 

lnf re 2 n (r) sup^^pj *K*V*» = ^^(P) inf^^pj *<«r,r» - v. 

PROOF OF THEOREM 16 . We omit details. 

If f -1 (x) is infinite then the set CU(y)|y G f“ 1 (x)} u 
fU(z)|U(z) /\ U(x) = A) is a family of open sets covering S. No finite 
subfamily can cover S. Thus ii) implies 1). 

By setting up a 1-1 mapping from S into a closed, totally dis¬ 
connected subset of the unit interval one can show that i) implies ii). 

We omit the construction of a function showing that when i) 
fails so does lii). 

To show that i) implies ill) one places on the sets of strate¬ 
gies a topology analogous to that on S- Then <<r,T> is a continuous 
function of <r and T. If i) holds then both Sj( r> ) and Sjj(P) are 
compact. Using the S^, of the proof of Theorem 15 one notes that 
S - 3 ± is closed. From this and the continuity of <<r,r> it follows that 
V jl (P^) is closed. Now ot > /3 implies Vjj (P ) c Xjj (P^) • Choose 
a sequence ol 1 > d^y ... > v converging to v. There Is a T Q G Vjj (P A ) 

for all n > 0. For any cr G ij(P), < «*- n so < v. 

4 5 • EXAMPLES AND QUESTIONS 

Simple examples obtained by inserting Indeterminate games as 
subgames show that various plausible conjectures are false. Throughout 
this section P* = (y Q , Yj, Yjj, Y, g, T, Tj, T^) will stand for some 

fixed game which is not strictly determined. The reader will find that 

sketching the topological tree corresponding to the rather laborious des¬ 
criptions given makes the ideas comparatively transparent. 

EXAMPLE 1. A subgame of a strictly determined game need not be 
strictly determined. 

Let (x Q , x 1 , ...) be any sequence of distinct positions. Let 

Xj ** Yj yj (x ± |i is ode), Xjj =* Yj^> u {x^|I Is even), X ** Xj u Xjj, and 
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let f(x) * g(x) if x G Y - y Q , f(y Q ) = x Q , f(x i ) = x ±-1 if i > l . Let 
Sjj be ((x Q , y Q , y 1 , ...) | (y Q , y 1 , ...) G Tjj) together with the sequence 
(x 0 , x 1 , ...) and let S z - ((x Q , y Q , y 1 , ..-)I(y Q , y,, - -.) G Tj), 

S * Sj w Sjj• If P = (Xq| Xj, Xjjj X, f, S, Sj, Sjj) then any 

T G such that T(x Q ) « x 1 belongs to '%j 1 (P). The subgame 

determined by the closed set {(x Q , y Q , y 1 . ..)|(y Q , y ]# ...} G T) C S is 
not strictly determined. 

EXAMPLE 2. The game P = (x Q , Xj, Xjj, X, f, S, Sj, Sjj) may be 
strictly determined while - r= ( x 0 , x r x n , x, r, s, s ir sj) is not. 

Let Xj, Xjj, X, f be the same as in Example 1 . Let Sjj be 
((x 0 , y 0 , y,, •••)Uy 0 , y,, •••) e T x ) together with (X 0 , X,, ...) and 
let Sj he l(x 0 , y Q , y,, ...}|(y 0 , y,, ••• ) 6 T n ). Again T( x Q ) - x 1 

implies T G V^. (P) . Each strategy in £j(- P) consists of a function 
on x 1 , x^, ..., and a function on Yj. If TG £jj(- P) and T(x Q ) = x 1 

then for any cr G P) > <^ T > = (x Q , x 1 , ...) G S n so T G (- P). 

On the other hand if T(x Q ) = y Q then <<r,r> = s, where s(o) = x Q , and 
s(i + 1) = t(i) and t - <<r*,r*> with cr* G 2j(P*)> T* G • 

Since P* is not strictly determined neither is - P. 

EXAMPLE 5- The intersection and union of strictly determined 

1 2 

games need not be strictly determined. I.e., there are sets S T and S T 
such that P 1 = (x Q , Xj, Xjj, X, f, S, Sj, S - Sj) are strictly determined, 

but P = (x Q , Xj, Xjj, X, f, S, Sj u Sj, S — (Sj u Sj)) is not. 

2 

Let r i be the game of Example 1 . Let S^ consist only of 

(x 0 , x,, 

An Interchange of the roles of the players shows that union may 
be replaced by intersection. 

EXAMPLE 4. There are games r = (x 0 , x r x n , x, f, s, s r s n ) 

and P» = (x^, Xj, Xjj, X', f'. S', Sj, Sjj) and a function <(> such that 
P is strictly determined while P* is not, although <t> is a homeomorphism 

1 1 

of S onto S' which carries Sj and Sjj onto Sj and Sjj. I.e., 
strict determinacy is not a topological invariant. 

Let P^ — (y q t Yj, Yu, ®i* ^ 9 ^i* -^ji^ 9 i = ^ t 2 Le two 
replicas of P*. Let x Q , x 1 , x g be three distinct positions and let 

(Zq, z|, ...} i = 1, 2 be two infinite sequences of distinct positions. 

Let Xj and Xj both consist of x Q , all Zj with j even and all 

y G Yj uy|. Let Xj-j- and X^j consist of x ] , x 2 , all Zj with j odd 
and all y G Yjj Let X = X' = Xj u Xjj.. Let ffy 1 ) = f’Cy 1 ) - 

g^y 1 ) for y 1 G Y 1_y o , f(Zj) = f'(zj) = for j > 1, f(z*) - x,, 

f(yj) - x 2 , f(x,) = f(x 2 ) = f(x,) = f’(Xg) = x Q , and f'Cz^) - f'Cy^) - x,, 
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t'(z%) - f'(y^) - X 2 . 

Let Sj be all sequences of the form lx Q , x s , y£, y,, ...) 
with (y*, y|, ...) 6 Tj, i - 1. a, together with (x Q , x,, z\, ...) 

I 

1*1,2. Let S and Sjj be determined accordingly. Let Sj be all 
sequences of the form (x Q , Xp y*, y|, ...} with (y*, y|, ..*} £ Tp 

i « 1, 2, together with (x Q , Xp z*, z|, ...), i « 1, 2. The homeo- 
morphism t is 


<|>({X 0 , X 2 , y*, y|, . 

••)) “ tx 0 » y*, y|, . 


x i* z o' z r • 

••)> “ x l» z o> z \’ ' 



We now list some questions whose answers we should like to know. 
QUESTION 1. Are there examples in which every subgame of 
f* * (x Q , Xj, Xjj, X, f, S, Sp Sp) is strictly determined, but 
- P - (x Q , X r X ir X, f, S, S n , Sj) is not? 

QUESTION 2. Are the union and interse'tion of absolutely 
determined games absolutely determined? 

QUESTION 5. How far can Propositions 10, 11, and 17 be extended? 
E.g., is T stric ; ly determined if Sj Js a G^? Does the family of sets 
Sj such that P is absolutely determined coincide with any of the well 
known families of sets, e.g., the Borel sets? 

QUESTION k. Is absolute determinacy a topological Invariant? 
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SIGNALING STRATEGIES IN n-PERSON GAMES 1 
G. L. Thompson 


Behavior strategies have been used successfully to solve a number 
of games, notably Poker (see, for example, references [1], [3], and [ 4 ]). 
However, the only way to solve games without perfect recall has heretofore 
been mixed strategies. In the first part of the paper we introduce the 
idea of signaling strategies, associated behavior strategies and composite 
strategies in n-person games, and prove that any payoff attainable by means 
of mixed strategies can also be attained by means of composite strategies. 

As a consequence any two-person game can be solved by means of composite 
strategies. 

A signaling strategy for a player is a pure strategy for that 
player restricted to that subset of his Information sets which prevent him 
from having perfect recall. Then a composite strategy consists of a mixture 
of pure signaling strategies, together with the assignment to each pure 
signaling strategy of a behavior strategy on the remaining relevant informa¬ 
tion sets. 

In Section 3 we give the definition of an agent of a player in an 
n-person game. Finally in Section 4 we discuss coalitions in n-person 
games in light of the previous parts of the paper. 

The proofs of all statements in this paper are quite trivial and 
it is felt that its contribution is conceptual in nature. Elsewhere in 
this volume (reference [5]) the ideas of this paper have been applied by 
the author to the solution of a simplified game of Bridge. 

$ 1 . BASIC CONCEPTS 

The description of an n-person game given by Kuhn in [2] will be 
used. The notation and definitions given there will be followed as closely 
as possible. The names of the concepts of [2] which will be used here are 
collected below, but definitions are repeated only when the notation given 
here is different, or when comparison with new definitions is made. Def¬ 
initions of new concepts are numbered. 

K is the game tree in which each move has at least two alterna¬ 
tives . • 


1 The preparation of this paper was supported by the Office of Naval Research. 
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The players are 1 = 0, 1, ..., n. 

Is the set of moves of the player. 

Aj is the subset of moves In K having exactly j alternatives. 
U is the aggregate of informations sets U. U^ is the aggregate 
of information sets of player i. 

If U is contained in P Q fl Aj then U is a one element set 
IX) and there is a probability distribution with all components positive 
on the alternatives at X. 

The above concepts are sufficient to define a game P (except 
for the payoff which will not enter this paper in an essential manner). 

DEFINITION 1. Let U be an information set for 
player i and let U v = (Z | Z follows some move in 
U by the v tn alternative) . Then U is a signaling 
information set for player i if, for some y and some 
information set V of player i, U y fl V ^ (|> and 
V C u v . 

The game tree of a two-person game is given in Figure 1(a). In 
this game, player 1 (P^ "forgets what he knew" and player 2 (P 2 ) "for¬ 

gets what he did." U 1 is a signaling information set for player 1. U 2 
is a signaling information set for player 2. 



Figure 1 

Let be the set of signaling information sets for player i. 
Clearly C U Prom the definition of perfect recall in [2] it follows 
that P has perfect recall for player i if and only if « <}. 

A pure strategy for player i is a single-valued function ir ^ 
on to the positive integers such that if U C Aj fi P i then ir^U) < j . 
Let Tk be the set of all ir^. 
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DEFINITION 2 . A pure signaling strategy for player 
1 is a single-valued function 0 -^ on ^ to the posi¬ 
tive Integers such that If U f ^ and U C A . then 
^(U) < j. Let be the set of all o^. (If - 

0 then X± consists of the single vacuous function.) 

In Figure 1(a) there are exactly two pure signaling strategies 
for player 1, one (call it ) that chooses alternative 1 at X 1 and 

the other (T.,) that chooses alternative 2 at Xj. Player 2 also has 
two pure signaling strategies. 

Since C there is a natural mapping y of TT^ onto 
where Wir^) is the strategy restricted to Thus ir^ is mapped 

by y onto that which chooses the same alternatives as does on 

the information sets U in Then y' 1 defines an equivalence relation 

on TT^ and partitions TT^ into disjoint classes. To each such equivalence 
class corresponds exactly one pure signaling strategy r^. Hence we denote 
these equivalence classes by the symbol TT^ • Then two pure strategies be¬ 
long to 17^ if and only If they make the 1 same choices as 0 -^ does for 
all U In 1 V 1 - 

If = <t) then y maps each tr^ onto the null set $ and 

Y" 1 (<p) =71^. In this case we shall speak of the vacuous signaling strategy 
<r. which makes no choice on any information set and for which TIL = TT . 
This convention will allow us not to have to distinguish the cases ^ 

and = ♦ In the statements that follow. 

As in [2] a pure strategy vector nr defines a function p x (it) on 
the moves X in K. A move X is possible when playing symbolically 

X Poss if and only if there exists a ir such that P x (ir/ir 1 ) >0. A 

move X is Poss (or^jir^) if and only if X Poss It ^ and € TT^. • An 
information set U £ 11^ is Rel if and only if some X in 1 U is 
Poss ir^. An information set U' G is Rel if and only if some 

X In U' Is Poss ( 0 -^: 1 ^). Define 1 T^X) =■ ('HjJ X Poss 1^}, T ± (U) - 
(1^1 U Poss = U X6U T^X), R,. (X) = (itjj X Poss ( 0 ^: 1 ^)), and 

R r {V') = lITjl U' Rel (<r 1 :ir 1 )} = ^ (X). 

‘ Let be the subset of all ^ moves X of K which are pos¬ 
sible for ir^. 1 Proposition 1 of [1] proves that Is a tree. Then 

let K = ^ir.CTT ^ir. * K r, Is also a tree. ^ Intuitively K r 

i i» JL i 

is the subset of 1 moves of K which can possibly occur If player i 

uses the signaling strategy r^. 

Let %L r be the partition 11 relativized to as follows: 

If U then 1 the information set U' *U/) is in 1 . We do 

not define information sets in for the other 1 players. 1 The order¬ 

ing and indexing of moves and * assignment of chance probabilities and 
payoffs in K^. is the same as for the corresponding moves and plays in K. 
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The trees K r and , shown In Figure 1(b) and 1(c)/corre¬ 
spond to the signaling * 1 strategies and Tj of player 1 In 
the game of Figure t(a). It Is not hard to construct the trees correspond¬ 
ing to each of the two signaling strategies of player 2 In Figure 1 (a). 

Although is not a game it Is possible to speak of signaling 
information sets and 1 perfect recall for player i in K r , since these 
concepts depend only on the information sets for that player 1 


PROPOSITION 1 . 


Player i has perfect recall in 



PROOF. If not, there exist moves X G U’, Y G V* for player i 
with X < Y and YCU; but V*. Now U v f\ V / 4> and U v o V or 

else V was a signaling information set in K and V* was defined in¬ 
correctly. Hence there is a move Z In V*, so that Z G , and a move 
Z 1 in U-U', so that Z 1 £ , with Z 1 < Z. Since K r 1 is a tree 

(that Is, every move in has 1 a unique predecessor) 1 Z f , a 

contradiction, which proves 1 the proposition. 1 

As a corollary to Proposition 1 of [2] we have the following 
proposition. 


PROPOSITION 2. Let the Information set U* con¬ 
tain the first move for player I, X, on a play W in 
the tree K . Then R_. (U*) -TL. . 

1 *i ®i 

A mixed strategy ^ for player i Is a probability distribu¬ 
tion on 71^ which assigns the probability q T| ^ to ir^. 


DEFINITION 3« A mixed signaling strategy 
player I is a probability distribution on X 
assigns the probability q r to 


v ± for 

^ which 


A mixed strategy vector jL defines a probability distribution on 

the moves X in K as follows: 
r i 


px (<r i : H 


otX) X , % 
n^eR^x) 






where c(X) is the product of the chance moves on the path from o to X. 
Define X Poss if and only if there exists a \l such that 

Px( r ± : f A /t L ±) ) °> and define, for U* G 11^, , U* Rel (®"^s/^) if and only if 
some X in XJ* is Poss (o^:^,). 1 


DEFINITION k. 
player i, fi ± (r ± ), 


An associated behavior strategy for 
is an assignment to each U* G 11^ 
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of a probability distribution b^, U* ,rf) on the 
alternatives at U*. Thus, if U* has j alterna¬ 
tives, then b(o“ i ,U»,*) > 0 and b(o“ 1 ,U',^) - 1. 

Note that when - 4>, that is, when player i has perfect 
recall, this definition of an associated behavior strategy reduces to the 
concept of a behavior strategy as defined in [2]. 


PROPOSITION 3. A mixed strategy for player i 
defines a mixed signaling strategy - (q^ ), and 

an associated behavior strategy . 1 Con¬ 

versely, given a mixed signaling strategy ** (q° ) 
and an associated behavior strategy ^(o^), there' 1 ’ is 
a mixed strategy ^ such that « V° and 

M°r ft) " ^i (<r i 5 • 


PROOF. Given p. ± = (q^) define - (q^) by 

(a) 


Q r 83 X q- 

r i ir.GT ^ 
1 r ± 


which is clearly a mixed signaling strategy. [N. B. If X± - $ then 

q^. - 1 for the (vacuous) signaling strategy cr^ in 2^. We denote this 

1 case by v* - 1 .] Define for U* G 36. 

l 1 / 

(b) ,<0 « X, . Q-f / 2, . 

1 1 ItjGR^OJ') *i.V ir ± GR r (U«) ^i 


JL X 


if U* Rel ( 0 ^:^), 

(.) ^ ^ % 

^(U'W 

if U* not Rel and q^ > o 

(d) b(<r 1 ,p. i ,U , ,J) is an arbitrary probability distribution if 


0. 


It is not hard to show that (b), (c), and (d) are probability distributions 
on the alternatives at U». 

Conversely, given y° * (q^) and define fi^ by 

(e) 

if €TT r will belong to exactly one such). The verification of the 

proposition^ follows by routine substitution into (a) through (d). 
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DEFINITION 5• The pair (^,^( 0 ^)) is called 
a composite strategy of player i. 

The Intuitive interpretation of a composite strategy for the i th 
player is given as follows: The strategist for player i chooses, with 
probability q^. , a signaling strategy 0 ^. Then the agents who control 
the information 1 sets in J^ then make their choices as dictated by 
and the agents who control the other information sets U in ^ - jmake 
their selections with probabilities dictated by among 'jhe alternatives 
at U. Another possible interpretation of a coirposite strategy is given in 
Section 3 of this paper. 

The following proposition is related to Proposition 3 of [ 2 ]. 


PROPOSITION 4. Let P be any game with game tree 
K and let W be any play in K. Let T ± (¥) = 

{iTjJ W Poss H^}, and let c(W) be the product of the 
chance alternatives on W, or 1 if there are no 
chance alternatives on W. Then for all ir = 

(1T 1 , ..., ir n ) and all W 


Pv (lt) 


f c(V), if it T ± (W) for I = 
I 0 , otherwise. 


n 


PROOF- By Proposition 1 of [ 2 ], W is possible for ir^ if and 
only if ir^ chooses all of the alternatives for player I on W. The 
statement then follows from the definition of Py(it). 

A mixed strategy jt * (fa , ..., p . n ) defines a probability dis¬ 
tribution on the plays W as follows: 


it 

c(W) 


o> Vf'-X.v - vv*> 

2 

ItjGT^W) ,all i 

where the last step follows from Proposition 4. 

Then the payoff vector H(p.) - (H 1 ([a.) , 
to a mixed strategy vector fi has components 




- V 

H n (^c)) corresponding 


( 2 ) 


H 1 ( H " ^ all w 


which represents the payoff to player 
A strategy vector jL - (ft 1 , 


if strategy p is used. 

— . .. ' hn )' 

in which the i w cojnponent is the composite strategy corre¬ 

sponding to the mixed strategy for player i, also defines a proba¬ 
bility distribution on the plays W of K. To see this, note that 
defines a, probability distribution q on the trees K— . Then for each 
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r, *i 

play W In K^. [nj.te that W is the same as some play W in K 

and hence 1 c(W *) - c(W)] let Q^W i ) * le | e is an alternative 

<r ± 

for player i on W ) and let U* be the information set containing the 
last move for player i on W i . Then the strategy vector fL' « 

(fL , /A i _ 1 , /* i+1 , •••» /* n ) defines a probability distribution on 

the plays in as follows: 


(3) P 




o(W) 




IT, 


qir i-i qir l+l 


% 


TT 

eCQ^W i) 


b(e) 


if U' Rel 
= 0, otherwise. 

In this formula empty products are to be set equal to 1 and W is the 
play in K which Is the same as the play W 1 In K r • In turn formula (3) 
defines a probability distribution on the plays W of^ K by 

(4) p w ( f ] = 2 w «i =w p w <r i ( ^' ) q »i ' 

Finally, the payoff vector K{jL) has components 

(5) = Sail W P W^ h i^ * 


Let I - {1, n}, let SCI be any subset of I and let 

I - S be the complementary set to S in I. Then repeated application 

of the above reasoning provides the payoff vector if the players i in S 

use the composite strategies and the players j in I - S use 

the mixed strategies /*•. 

J 

$ 2. A THEOREM ON COMPOSITE STRATEGIES 

The following lemma is closely related to the sufficiency part of 
the proof of Theorem 4 in [2 3. 

LEMMA. Let /t « (yu^ , ft n ) be a mixed strate¬ 
gy vector and let 

A “ (/V ( v i^i)» /*i+i * 

where is the composite strategy corresponding 

to fi ± . Then PyC/'O * P w (j£) for all W in K. 
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PROOF. Let W be any move in K. If W contains no move of 

player i the lemma is obviously true. If W contains a move for player 
i let X be the first and Y € U the last move for player i on W. 

Let be any signaling strategy with > o and such that W is con¬ 
tained in K, that is, such that W - 1 W 1 for some W 1 in K_ . 

By (3) 1 1 

(6) P w ^> - 0. 7r ^ Me), If U 6 Rel^ , 

« 0, otherwise. 


where C is a constant defined in (3). Consider the quantities b(e) 
arranged in the same order as the alternatives e for player i on W 
are arranged. By Proposition 2 the denominator of the first one is exactly 




By Proposition 1 of [2] the numerator of the first is 


cancelled by the denominator of the second, the numerator of the 
second cancelled by the denominator of the third, etc., until only the 
numerator of the last fraction remains. The last numerator is equal to 
Then one can write (6) as 


2 '»r 1 eT i (w ,ri ) Q V 


(7) Pr^’l 


Si 


c(W) 

Y T j (w '* r i ' ‘ 


’ ^TT S IT. V 

11 1l i eT l( W ± 


2 - n 

q oj *.GTj(W 1 ) ,all j *1 


% 


Substituting (7) into (4) gives the statement of the lemma. 

In the following theorem the sets S and I - S are defined as 
at the end of Section 1. 


THEOREM. Let V be a game, S a ’subset of the 
players, and - (/^, ..., ji n ) a strategy vector. 
Let Y be the function defined as follows: 




r tv 1 (/< 1 ),/! 1 (<r^)] - (1,/Sjh if 16 3, 
fi v If 1 6 I - 3 . 


Then if /Z is the strategy vector Yty n )] 

we have H (p) » H (ft ). 
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PROOF* By repeated applications of the lemma and the remark at 
the end of Section 1 * 

Intuitively this theorem means that any payoff which players can 
obtain by means of mixtures of pure strategies, the can also obtain by 
means of composite strategies. This theorem together with the fact that 
the normalized form of the game obscures signaling strategies, explains one 
reason why the normalized form of the game is not always the best form in 
which to solve actual games. 

COROLLARY* Any zero-sum two-person game can be 
solved by means of composite strategies. 

i 3- THE DEFINITION OF AN AGENT 

In [ 2 ] an agent Is postulated to control each information set of 
a player. In many actual games, for example bridge, rummy, canasta, etc*, 
an agent obviously controls more than one information set (see Figure 1 of 
[5])* To formalize this, we broaden the definition of an agent to a con¬ 
cept similar to that found In practical games. 

DEFINITION 7* By the agent partition of player i 
(i > 0) we shall mean a partition of the information 
sets of player i into sets , .. *, U ^ , 

(t^ > 1), such, that, if P ik is the set of 1 moves 
in the Information sets contained in 2^, then the 
moves in P ik satisfy the condition of perfect recall. 

The moves In P^ will be called the moves of 
agent ik meaning "the k agent of player i." 

If each P^ contains exactly one information set then this 
definition of an agent coincides with the one given in (2 ]. The require¬ 
ment of perfect recall Is added to the definition of an agent to capture 
the intuitive Idea that an agent is a single personality and thus avoiding 
the problem of "split personalities," (see [4] p. 53 ). The agent partition 
may be given by the rules of the game as in bridge and other card games, or 
It may be up to the player himself to choose the partition as in certain 
economic situations. 

We can think of player i using a composite strategy (V^,^) 
as follows: The agents of player 1 meet before the game Is played and 
decide (by means of a chance device and the probabilities given by V$) 
which signaling strategy <r± to use, this decision, of course, being kept 
secret from the other players in the game. The agents who control informa¬ 
tion sets relevant for <r^ then are instructed to choose the alternative 
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dictated by (r^ at those information sets. The agents controlling other 
information sets make choices as dictated by ^(cr^). 

In [ 5 ] the author solves a simplified bridge game by means of 
composite strategies and with the use of this notion of agent. 

( 4. REMARKS ON n-PERSON GAME THEORY 

The formulation of the general theory of n-person zero-sum games 
is given in [4] p. 238 , ff. It is assumed there that if a non-empty, 
proper subset S of the set of players I forms a coalition, then they 
will "fully cooperate" with each other and become a single player. This 
could be formulated as follows: The set of agents of the composite player 
S is the union of the sets of agents of each of the players i In S, 
and it is assumed that these agents will cooperate as a single player. 

It is not entirely clear under what circumstances the agents of 
the players in a coalition will be allowed to cooperate with each other 
under the rules of P, nor exactly what It means for them to cooperate. 

The answer to these questions is not difficult. Suppose S = (1, ..., t) 
where 0 < t < n is a coalition of players in p. A pure strategy for the 
coalition S consists of a vector ir = (rr^, ..., rr. j.) taken from the 
(cartesian) product space of the pure strategy spaces for the players i 
in S; that is, IT £ TP^g OJ^)» where IP denotes the cartesian product. 

A mixed strategy for the coalition is then an assignment of a probability 
distribution on these pure strategies. Let Mg be the set of all mixed 
strategies. We shall say that a mixed strategy jl in Mg Is allowable in 
P If it can be used by the coalition S In P. Then the first answer to 
the question posed above is: 

The agents of the players in S can fully cooper¬ 
ate as a single player (coalition) in P if and only if 

each mixed strategy /-c in Mg is allowable in p. 

From this remark it is clear that the specification of the allowable strate¬ 
gy spaces should be included in the definition of a game. 

The theorem of the last section allows us to reformulate this 
remark in a way that is easy to apply to some actual games. Let V and f> 
be the mixed signaling strategies and associated behavior strategies 
respectively for the coalition S considered as a single player. Let us 
say that the strategies y and £ are allowable In P if they can be 
used in any way by the coalition S in P. Then we can say: 

The agents of the players in S can fully cooper¬ 
ate as a single player in P if and only if each of 
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the composite strategies (v,/J) for S is allowable 

in r. 

In reference [ 5 ] there is an exanple of a simplified two-person 
bridge game with enforced coalitions in which only pure signaling strategies 
are allowable. 
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BRIDGE AND SIGNALING 1 
G* L. Thompson 

Bridge has long been a favorite parlor game that has held and 
continues to hold ascendancy over most other cara games. There are a num¬ 
ber of reasons for this popularity, some of which we discuss below. 

First of all, bridge is complicated enough that many different 
situations can arise, with no set of similar situations appearing so often 
that the game becomes boring. There is always a new problem to be solved, 
a new "strategy” to be devised. Second, the payoff in bridge varies with 
such factors as doubling, vulnerability, the suit that is trump (or no 
trump), etc. Hence, there is the possibility that the player's strategy 
should change with each change in payoff. Third, a player in bridge has 
imperfect information, both as to the cards held by his opponents and as to 
the cards held by his partner. He must therefore make his strategy depend 
on the most likely distributions of cards in the other players' hands. 

There are two important consequences of this last observation. 

The players' lack of information about the cards in their opponents' hands 
means 2 that there probably is no "best" way of playing bridge. Finally, 
the players 1 lack of information makes signaling ^ among the players in the 
game possible and desirable. 

It is in the subtlety and importance of signaling that bridge 
differs most characteristically from other card games, such as rummy or 
canasta, which have to some extent the phenomena noted above. Both direct 
signaling (signaling between partners), and inverted signaling (deceptive 
signaling or bluffing against opponents) occur in bridge. It is the 
presence of signaling that makes bridge particularly interesting to game 
theoreticians. 

In this note we discuss a simplified bridge model played both as 


1 The preparation of this paper was supported by the Office of Naval Research. 

2 Cf. Theorem 7 of [2). Actually it is also necessary to verify that the 
payoff of bridge is such that mixed strategies are needed to solve the 
game. This is true for the bridge models discussed here. 

5 The first discussion of signaling occurs in [6] pp. 53, The remarks 

made in [5] about games without perfect recall in general, and bridge in 
particular, are also relevant. The definition of a signaling strategy is 
given in [ 7 ). 
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a two-person and as a four-person game, the latter being closer to ordinary 
bridge. The models discussed are similar to the play of the last two 
tricks in a hand of bridge. Good strategies^ are devisea for playing a 
single hand^ of each game. Both models exhibit the types of signaling 
described above although the signaling in the two-person game is more 
subtle than that in the four-person game. Finally, we observe that the 
four-person game 'cannot be directly treated by means of characteristic 
functions, ^ hence a new definition of solution for that game is defined and 
used. 

In discussing bridge we shall assume that the reader is familiar 
with the technical terms of bridge (which can be found, for example, in [4], 
p. 100, ff.). We shall use as few of the technical concepts of game theory 
as possible (relegating them to footnotes wherever possible) so that almost 
anyone familiar with bridge can follow the discussion by using his "bridge 
sense." 


4 1. DESCRIPTION OF THE BRIDGE MODELS TO BE USED 
The deck of cards customarily used in bridge contains 52 cards. 

28 

The number of deals possible with this deck is then approximately 5-10 
Since a complete analysis of bridge requires that every deal be "played 
out," the amount of labor required to completely analyze ordinary bridge is 

7 

clearly prohibitive. There are several ways of making simplified models 
of bridge, one of which we discuss here. 

In the model which we shall discuss there are four players 8 who 
are called North, East, South, and West. East and West together form a 
pair, East-West; similarly. North and South together form a pair, North- 
South. The rules concerning the order of deal and play, taking of tricks. 


^The mathematical justification of our method of finding the good strate¬ 
gies appears in [ 7 I• 

^Actually, as observed in [6] p. 49 , a play of bridge should be a "rubber." 
The payoff function in the bridge models considered here is not sufficiently 
close to the payoff function In bridge to make this necessary. 

^For the definition of characteristic function see [6] p. 238 ff. The 
technical reasons why the four-person bridge model cannot be solved by 
characteristic functions are discussed in [ 7 ]• 

^Even the amount of labor required to describe the game tree of bridge is 
enormous. Chapters 1-4 of [1] are almost entirely devoted to an analysis 
of this problem. 

®The technical term for what is here called "player" is "agent," a defini¬ 
tion of which Is given in [ 7 ], section 3- The term "player" is used 
technically to indicate what is here called a "pair," that Is, a coalition 
of two "agents." 
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trump and no trump, etc., are as in ordinary bridge. In addition we make 
the following simplifying assumptions: 

a. The number of cards in the deck is to be eight, divided into 
four suits with two cards in each suit. The four suits are called 

1 ) spades, 2 ) hearts, 3 ) diamonds, and 4) clubs, ranked in that order. The 
two cards In each suit are called ace and king with ace ranking over king. 

b. The bidding stage of bridge is omitted. Instead the declarer 
and trump suit (or no trump) are determined by a random device . 9 In par¬ 
ticular discussions it will always be assumed that South is declarer. North 
is dummy, and West leads. By Interchanging names one can arrive at any 
other situation. 

c. Scoring is to be done as follows: The payoff to the pair 
East-West is to be two units if the pair takes both tricks, one unit if the 
pair takes one trick, and zero units if the pair loses both tricks. North- 
South is to receive the negative of these amounts. It is also assumed that 
the players in each pair share equally in the payoff. 

d. We shall assume that the shuffling is perfect, that is, the 
order of cards after shuffling Is independent of the order before shuffling. 

It is probable that this particular model would have little 
interest in itself as a game for bridge players. Note, however, the simi¬ 
larity between this model ana the play of the last two tricks in ordinary 
bridge. The main difference is that the information pattern in a play is 
different from that assumed here. In particular, note that the dummy. 

North, would have laid down his cards before West leads. 

The analysis of the model given here is not trivial and, as we 
shall see. It has many of the essential properties of bridge. 

By the simple rules of combinatorial analysis (see, for example, 
reference (31) the number of deals is 8 !/( 2!) 4 = 2,520 and the number of 
different hands is 81 /( 216 '.) = 28 . These hands are divided as follows: 
four hands with ace and king in the same suit, twelve hands with ace and 
king in different suits, and six hands each with two aces or two kings. 

Since there is no bidding the only Information given to each 
player is the knowledge of the cards In his nand plus those cards exposed 
in the dummy’s hand and those exposed during the play. When West leads he 
has knowledge of the two cards in his hand, hence he knows that one of 
61 /( 21)5 = 90 deals has occured. After West leads. North, as dummy, lays 
down his hand so that South, who plays for North, knows where all but three 
of the cards are (one in West's hand and two in East's). These can be 
distributed in three different ways, hence South knows that one of three 


9 The determination of the trump suit by a random device is used in the game 
of whist, a forerunner of bridge, the rules for which are given in [4]. 
However, whist is not played In no trump. 
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deals has occurred. At East's move. East knows where all but three of the 
cards are (one In West's and two in South's hand), hence knows that one of 
three different deals has occurred. After East plays, South knows all 
cards but two (one in West's and one In East's hand}, hence knows that one 
of two deals has occurred. To illustrate this information pattern we draw 
part of the game tree for this model of bridge (for definition of game tree 
see [5]). Readers not familiar with game thoery can recognize Figure 1 as 
a graphical picture of the discussion in the paragraph above. 



Figure 1 

The oval curves indicate information sets and each one is labelled with the 
player who controls it and the number of moves which it contains. Note 
that North-South has perfect recall (see ref. [ 5 ]) although East-West does 
not. 

In the following sections we shall solve this simplified bridge 
game. It may be advisable to indicate to those readers who are versed In 
game theory the theoretical basis on which this will be done. It is proved 
in [ 7 ] that any game can be solved by means of signaling strategies and 
associated behavior strategies. Only the pair East-West has any signaling 
strategies (since North-South has perfect recall). We determine all pure 
signaling strategies for East-West, eliminate some of them by domination, 
then observe that a mixture of the remaining is optimal. With respect to 
these signaling strategies we determine the good associated behavior 
strategies by means of domination. 

{ 2. SIGNALING STRATEGIES IN THE NO TRUMP CASE 


Suppose South is declarer and the game is to be played in no 
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trump* It is not hard to see that if West has an ace he should alvays lead 
It since it will surely take a trick, whereas if West saves the ace there 
is only a small chance of making it good. If then East-West agree that 
West should always lead an ace if he has one, this already constitutes a 
direct signal between East and West (it also signals indirectly to North- 
South) , in that a king led by West always indicates that his other card is 
also a king. 

If South has two kings, this signal will not reduce the number of 
moves in East's information set, but in this case the issue will be settled 
by the distribution of the aces held by North and East. In the other cases 
the number of moves in East's information set is reduced from three to two 
(if South has one ace) or one (if South has two aces). 

There remains only one case in which this signaling can be 
improved. It is illustrated in Figure 2(a). 



A , Ag A k 

(a) (b) 

Figure 2 


If West leads the king K 1 in 2(a), then East (knowing from*his own and 
the dummy's cards that South will take the trick) is left in a quandry as 
to which of his aces to discard. If he saves the right one he can take the 
second trick; if not, he will lose it. He does not know which king is held 
by South, hence does not know what the last lead will be. Thus if West's 
king lead could also tell East what the other king in West's hand was, then 
East could determine which ace to save. 

The reader can easily devise ways of signaling this information; 
for example, always lead the lower ranking suit. It is clear that, since 
there are six possible two-king hands and only four possible leads, the 
signaling cannot be perfect; that is, there must be a certain lack of in¬ 
formation even if East-West adopts a signaling strategy. Examples of the 
four possible ways of signaling (we shall call these signals) appear in 
Figure 3 . An x corresponds to the card to be led and the numbers 1, 2, 

3, and k refer to the four suits. 
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Type 

1 2 

1 3 

1 4 

2 3 

2 4 

3 4 

3111 

X 

X 

X 

X 

X 

X 

3210 

X 

X 

X 

X 

X 

X 

2220 

X 

X 

X 

X 

X 

X 

221 1 

X 

X 

X 

X 

X 

X 


Figure 3 

The numbers indicating the type of signal are obtained by counting 
the number of hands with the same lead. It is easy to show that there are 
eight signals each of types 3111 and 2220 and twenty-four signals each 
of types 3210 and 2211 . 

It is not hard to see that signals of type 2211 are better than 
signals of type 2220 and signals of type 31 11 are better than type 
3210 . By examing the possible situations in which signaling is relevant 
it can be shown that signals of type 2220 are just as good as type 3111, 
so that signals of type 2211 transmit the most information. It Is then 
clear that only type 2211 signals should be considered for use by East- 
West. 

By a pure signaling strategy 10 for East-West we shall mean an 
unambiguous command to West which card he shall lead for every possible 
hand. Certain elements of the signaling strategy have been discussed above 
but it is instructive to write down completely an example of a pure sig¬ 
naling strategy. The signaling strategy below refers to West’s hand only. 

a) If the hand contains two aces lead the higher ranking. (The 
signal of type 3210 Illustrated In Figure 3-) 

b) If the hand contains ace and king lead the ace. 

c) If the hand contains two kings use the type 2211 signal 
illustrated in Figure 3- 

As observed above it is immaterial, as far as the payoff obtained 
is concerned, what the command at a) is. Moreover, the command b), as 
given, clearly dominates any other possible command at b). Also, it was 
observed above that any signal used in c) which is not) of type 2211 is 
dominated by a signal of type 2211 . We shall therefore ignore part a) of 
the strategy, assume that part b) of the strategy is the same for all 
strategies considered, and then the only difference in the signaling strate¬ 
gies is the choice at c) of one of the 24 possible type 2211 signals. 


10 


The precise definition of a signaling strategy Is given in [ 7 ]. 
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It might seem that East-West could use one of the signals of 
type 2211, for example the one given in Figure 3, as a pure strategy. If 
this were an optimal strategy, East-West would not care whether or not 
North-South found out this strategy. However, Figure 2(b) illustrates a 
case in which North-South can profit from knowing East-West's strategy. 

The deal in which the hands of North and South in 2(b) are interchanged is 
also a case in which North-South profits. Since 2(a) and both variants of 
2(b) are equally likely we see that North-South stands to profit twice as 
much as East-West from such a pure signaling strategy. 

Suppose that East-West selects at random (that is, with equal 
probability) one of the 24 signals of type 2211 to use before each hand 
is played. Since both East and West know which signal is actually selected 
and used for the hand, and this knowledge is kept secret from North and 
South, we see that the desired information is successfully signaler, from 
West to East. That is, North-South cannot araw any conclusions from a king 
led by West as to the identity of the other king in West's hand, but East 
can. This concealing of information Is an example of Inverted signaling. 

It can be seen from symmetry considerations that no other mixed signaling 
strategy dominates this one. 

The selection of a private signal between East and West violates 
the rule 11 of bridge stating that all unusual signals between players must 
be announced. This Is equivalent to saying that only pure signaling strate¬ 
gies can be used. We therefore define a two-person bridge game to be one 
in which any mixed signaling strategy is allowed and a four-person bridge 
game one In which only pure signaling strategies are allowed. 

The above discussion shows that in the four-person game it is 
unprofitable for East-West to use a pure signaling strategy. Hence in the 
four-person game West should lead either of the two kings at random. 

4 3. GOOD STRATEGIES FOR THE NO-TRUMP CASE 

In this section we devise good strategies for the players by 
using "bridge sense" and the results of the last section. Then we give a 
brief discussion of the reasons which make the given strategies optimal. 

Good strategies for both the two-person and the four-person 
bridge game follow. 

For West . If West's hand consists of two aces, lead arbitrarily; 
If It consists of ace and king, lead the ace; if it consists of two kings, 
use the mixed signaling strategy given in section 2 (for the four-person 


11 The following sentence is found on p. 1 38 of [4]; "It is improper to 
employ an unusual convention in play without informing the opponents of Its 
significance." The penalty for violating this rule is "ostracism." 
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bridge game this part of the strategy is replaced by the phrase "if it 
consists of two kings, lead at random"). 

For North (played by South). Follow suit; or discard any worth¬ 
less card; or discard king before ace; or, if the hand consists of two aces, 
discard at random; or, if it consists of two kings, discard arbitrarily. 

For East . Follow suit; or discard any worthless card; or discard 
according to West's signal (this phrase is eliminated in the four-person 
bridge game); or discard king before ace; or discard arbitrarily. 

For South . Follow suit; or discard any worthless card; or discard 
king before ace; or discard arbitrarily. 

In applying the strategy the player is to use the first applicable 
phrase. By a random play we mean that the player is to use a chance device 
which will select each of the two alternatives (assuming the cards are 
numbered in the order in which they are dealt) with probability 1/2. By 
an arbitrary order of play we mean that it is immaterial which card is 
played first. A card is worthless to a player if he can determine from his 
information that it will never take a trick or, if discarded, will never 
give useful information to his opponent. For example, an ace is worthless 
to North if South has the king of the same suit and neither North nor South 
can take the first trick. 

It Is clear that these are strategies, that is, that there Is a 
command to cover every situation. It also is easy (although tedious) to 
check, by playing out each deal, that the parts of these strategies, ex¬ 
clusive of the signaling, arbitrary playing and random discarding, are as 
good as any other strategy and that there exist deals for which deviation 
from these strategies causes over-all loss. The use of the signaling 
strategy given was justified in the last section. We must still justify 
the random discard and arbitrary play commands. 

If North has two kings then neither will take either trick and, 
since North is dummy, both are exposed to all players. It is therefore 
clear that any strategy for discarding, pure or mixed, is good, hence the 
discard can be arbitrary. If North has two aces the situation is different 
even though both are exposed. It can be shown (the details are tedious) 
that if North uses a pure discard strategy of any type then East-West can, 
by deviating from his optimal strategy and using a suitable countering pure 
signaling strategy, profit from it. However, North can safely use random 
discarding in either game. Note that this is inverted signaling. 

If East has two kings then a simple analysis of the possibilities 
shows that no discard strategy, pure or mixed, can give useful information 
to North-South. If East has two aces then an analysis of the possibilities 
shows that the only type of deal in which East does not know what to discard 
(or that it does not matter) is that shown in Figure 2(a). For the two- 
person game this is precisely the case in which West is signaling to East. 
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Since the signals of type 2211 are not complete there are still two 
situations for each signal in which East cannot decide what to discard. It 
is clear from Figure 2(a) that, regardless of which discard is made, no 
useful information is imparted to North-South, hence an arbitrary discard 
is good in the two-person game. For the four-person game Figure 2(a) again 
shows that the arbitrary discard is as good as any. 

The analysis of South's discard strategy is similar to that for 
North and shows that the arbitrary discard strategy is good. 

4 4. THE VALUES OF THE GAMES IN THE NO-TRUMP CASE 

It is evident from the symmetry of the rules, and the randomness 
of the deal and choice of declarer, that both the two-person and four- 
person games are fair, i.e., their value is zero. It Is still of interest 
to calculate the expectation of the players once the declarer has been 
determined. As might be expected, having the lead Is an advantage. 

If West has two aces or a complete suit then, regardless of the 
strategies employed by any of the players, East-West will get both tricks. 
Hence in these cases East-West has an expectation of — . 2 = 5 / 7 . The 
other expectations are more difficult to compute. The best way of doing it 
Is to assume hands for West and East and then to arrange the other cards In 
the six possible ways between North and South. Compute in each case the 
probability of each hand and the amount East-West (say) can get using his 
optimal strategy. With a little experience one sees how to group similar 
situations together and thus to shorten the calculations. The two-person 
game value to East-West is 1.431. Recalling the definition of the payoffs, 
this number can be interpreted as the expected number of tricks which East- 
West can take. 

The four-person bridge game is one in which there are enforced 
coalitions and rules disallowing private signaling, hence this game cannot 
be solved by means of characteristic functions.^ However, note that the 
strategies as given in the previous section for the four-person game have 
the following intuitive characteristics: (1) each pair of players can 
assure itself of a certain minimal amount regardless of the strategy of the 
opponents; (2) no pair of players can, by its own efforts or by the 
individual effort of any player in the pair, increase its expectation with ¬ 
in the rules of the game * These criteria are discussed at length for the 
two-person zero sum case in [6], Chapter III (see particularly pp. 1 01-102 
and p. 159)• 

If the above criteria are accepted as a definition of the value 
of the four-person game given, we can compute its value as 1.428. The 
increase in expectation due to signaling is then . 003 . 
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4 5 • GOOD STRATEGIES AND VALUE IN THE TRUMP CASE 


Suppose that the declarer and trump suit are chosen at random. 

For purposes of discussion we assume that the declarer is South. From the 
game theoretical point of view this game is not as interesting as the 
no-trump case since there is no opportunity for the more subtle type of 
signaling previously discussed, hence there is no difference between the 
two- and four-person games. Good strategies are given below. 

For Vest . If West’s hand contains both trump cards lead 
arbitrarily; if it contains the trump ace and a non-trunp card, lead the 
trump ace; if it contains the trump king and a non-trump card, lead the 
non-trump card; if it contains two non-trump aces or two non-trump kings, 
lead at random; if it contains a non-trump ace and king, lead the ace. 

For North . Follow suit; if North's hand contains both trumps 
play arbitrarily; If It contains a trump card and a non-trump card, trump 
if South cannot take the trick, otherwise play the non-trump card; finally 
if North's hand contains two non-trunp cards, play any worthless card, or 
discard king before ace, or discard at random. 

For East . Follow suit; or truirp or overtrump if West does not 
have the trick; or discard any worthless card; or discard king before ace; 
or discard at random. 

For South . Follow suit; or trump or over-trump if North does 
have the trick; or discard any worthless card; or discard king before a 
or discard at random. 

The Interpretation of these strategies is similar to the no-trump 


case. 

The value of the game Is computed as for the previous case, 
assuming that South has been chosen declarer. Possession of the lead is 
again important but not as important as in the no-trump case. The value of 
the game is 1 .101 . 


i 6. REMARKS 

The examples treated In this paper have several possible exten¬ 
sions and raise several questions which we list below. 

(a) Elsewhere the author will discuss these bridge models with 
the bidding stage added. 

(b) There are obvious extensions of the problem to considerations 
of models with more cards in the deck. This would increase the difficulty 
of the computations and would bring in new types of signaling. 

(c) How do the good strategies change if the shuffling is not 

perfect? 

(d) . What is the range of validity of the definition of the value 
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to the four-person game given in section 4? 

(e) (Suggested by A. W. Tucker). Find the good strategies for 
two-trick end-play situations in ordinary bridge. The necessary models can 
be obtained from the ones used here by suitably changing the information 
patterns. 

In this paper we have dealt with the problem of private signaling 
between partners by redefining the game to be a four-person game. There 
are other possible resolutions of this difficulty. In the first place, 
the wording of the rules of bridge in Hoyle is sufficiently ambiguous that 
it might be argued that private signaling of the sort described is actually 
permissible. It is the author's opinion that, at least in the spirit in 
which the rules are usually interpreted, this is not the case and private 
signaling is unethical. Accepting this, one could still regard our bridge 
model as a two-person game if one changed its extensive form to include 
preliminary moves at which each pair announced its pure signaling strategy, 
i.e., its leading conventions. However, if one wishes to preserve the 
extensive form of the model, then the only remaining alternative is the 
one chosen in this paper, namely, to redefine the game as a four-person 
game with enforced coalitions. As observed above, this requires a new 
concept of solution in a four-person game. 
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SUMS OF POSITIONAL GAMES 1 
John Mllnor 

Many common games, such as chess and checkers, exhibit a struc¬ 
ture in addition to that which is necessary to define their game theoretic 
properties. By a position in such a game will be meant merely the physical 
setup of the board without any specification as to which player is to 

p 

move. In these games a set of possible moves is defined at each position 
for each of the players, even though only one of them will actually be able 
to move from this position in any particular play of the game. In this 
paper an operation of addition will be defined and studied for games having 
this structure. 

The games to be considered may be described as follows. There is 
a finite set of possible positions P and a starting position p Q £ P. 

For each p G P and each player 1=1,2 there is a set of possible 
moves M^(p) C P. These are to satisfy the following finiteness condition. 
Every chain Pj, P 2 , P 3 , ••• positions such that 

Pj + , 6 M,(Pj) u M 2 (Pj) , j - 1, 2, 3, ••• 

must terminate. In particular a p ass p £ M^Cp) is never possible. For 
each p such that one player has no possible move, that is such that 
M 1 (p) or M 2 (p) is the vacuous set <p, the other player shall also have 
no move^ and the payoff functions lc 1 (p) = -k 2 (p) shall be defined. The 
players are to move alternately starting at p Q until one is unable to 


^he preparation of this paper was sponsored (in part) by The RAND 
Corporation. 

2 This is not quite precise. Chess, for example, is complicated by the rule 
that if a ,, configuration, ,, in the sense of the physical setup of the board 
together with the player whose turn it is to move, is repeated three times 
then the game is a draw. In order to allow for this it Is necessary to 
define a position as the setup of the board together with the set of con¬ 
figurations which have occurred since the last irreversible move. 

^This requirement is not too strong since, if It does not hold, it is only 
necessary to add some fictitious moves and positions to the game in order 
to satisfy it. For example in chess the move of taking the pieces off 
the board when the game is stalemated could be added. 
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move, arid then each is to collect his payoff. The information is perfect 
and there are no chance moves. 

For each player i and position p, let v^Cp) denote the 
value of the game for i if it is i's turn to move at position p. It 
is characterized by the equations 

v ± (p) = k ± (p) for M^p) - f 

v,(p) = Max (-v, )) for M,(p) ^ <|> . 

1 p^M^p) 3-1 1 1 

In particular we have the Inequalities 


(D 


v^p) “ v 2 (Pi) for Pi G (p) 
V 2 (P) > -v^p^ for p 1 £ M 2 (p) . 


In case the equality holds In one of these inequalities, the move p 1 Is 
called an optimal move . By the value of a game G will be meant 
v 1 (G) «■ v i(P 0 )* where p Q is the starting position of G. 

By the Incentive I(p) which a player has to move at position p 
will be meant the amount he would gain by moving rather than passing if he 
were given this choice. Thus if player 1 moves at position p and both 
players play optimally the payoff to 1 will be v 1 (p). If player 1 were to 
pass, however, his payoff would be -v 2 (p). The amount he gains by moving 
rather than letting 2 have the l'irst move Is therefore given by the 
symmetrical expression 


( 2 ) I(p) = v 1 (p) + v 2 (p) . 

By the sum of a game G and a game G’ will be meant the game 
in which a player has the choice of moving in G and passing in G* or 
passing in G and moving in G* on each move, and in which he tries to 
maximize the sum of his payoffs.^ Thus a position p + p* in G + G* is 
a pair of positions (p,p’) £ P x P‘ and the possible moves are 


M ± (p + p’) - M ± (p) xp 1 u p x M ± (p•) . 


]i 

More generally the payoff in the sum game could be defined by 
k,(p + p r )f 1 (k 1 (p), k 1 (p*)) 

where f. is any function which is monotone in each variable. General¬ 
ized sums of three or more games could be defined in the same way. 
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Not© that game addition is an associative, commutative operation. 

In order to get some information about v i (p + p») and 
I(p + P') it is necessary to construct specific strategies for G + G* 
in terms of known strategies for G and G*. Thus in order to get an 
upper bound for v 1 (p + p') it is necessary to construct a strategy for 
player 2. Define such a strategy by the following rules: 

a) Always make a move which Is optimal in G or G* . 

b) If possible move in the game in which player 1 has just 

moved.^ 

If player 1 is to move at position p + p* and 2 follows these 
rules, there are two cases. If 2 is always able to follow rule b), then, 
considering only those moves which were made in game G, the players have 
moved alternately. Since 1 has moved first and 2 has made optimal moves, 
the payoff to 1 In game G is at most v 1 (p). Similarly his payoff in 
G* is at most v^p')- Therefore in this case 

v 1 (p + p') < v ] (p) + v 1 (p') . 

It may happen, however, thac at some point 2 is unable to follow rule b) 
since the game in which 1 has just played is over. In this case, con¬ 
sidering only the moves made in the other game from the starting position 
p or p', player 2 is forced either to move twice in a row, or to make 
the first move. If this happens at position p 1 then it will be shown 

that the payoff to player 2 will be augmented by I(p 1 ) and the payoff to 
player 1 will be bounded by v ] (p) + v^p') - I(p 1 )• Suppose, for example, 
that 1 has finished the game G' by making the move p 1 and that it is 
2 *s turn to move at P 1 + P 1 • Since the players have moved alternately in 
both games, and since player 2 has moved optimally we have (by repeated 
application of the inequalities (1) for player 1 and the corresponding 
equalities for player 2) 


v i ( ?i) < v i ( p) 

v^pj) < v,(p') • 

Since the game G' is over, the payoff to 1 In G' la = v 1 (p 1 ) . 

Since the player 2 will make optimal moves In G the payoff to l in G 
will be at most Therefore 


^The following rule would also be sufficient 

b') If possible move In the game in which the incentive is 

highest. 



milnor 


v,(p + p’) £ -v 2 (p,) + v j ( pP “ -KPi> + v,(p,) + v t<P{) 
<-!(?,) + v^p) + v,(p') . 


If ve define 


D - Max (o, -I(p,), -I(pj)) , 
P,6P. P{GP' 1 1 


It has thus been proved that 


v,(p + P') i v,(p) + v,(p') + D . 


Letting player 1 use the same strategy. It follovs that 


v.(p) - v«(p 1 ) - D 


v p (p) + v.(p') - D 


< v. (p + p') 


In many games the incentive can be negative and D is therefore 
not zero. In chess for example the phenomenon of being forced to move when 
one would like to pass Is called Zugzwang. The preceding inequalities are 
extremely weak for such games, however, so we will consider only games in 
which I(p) > 0 for all p G P, henceforth . For such games D = 0 and 
therefore we have the following statement which will be basic for the 
remainder of this paper. 


V^p) - Vg(p 1 ) 

- v 2 (p) + v,(p') 


< v,(p + p') < V,(p) + v,(p’) 


In particular, substituting in equation ( 2 ) we have the "metric" inequality 
(**) II(p) - I(P')I < I(p + p') 1 I(p) + I(p’) • 

Since the left side Is non-negative. It follows that In forming sums of 


°Por the generalized sum of footnote 4 we would have by the same method 
f.(v.(p), -v 2 (p')) 

(3'), f £ v,(p + p') £ f,(v,(p), v,(p')) • 

f t (-V 2 (p), V^p')) J ill 

Both of these formula remain true If the Indices i and 2 are Interchanged. 
Similar Inequalities hold for generalized sums of three or more games. ' 
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games we preserve the condition that I be non-negative. 

Define two games G and G* to be equivalent G ^G* if for 
every G'• the condition 

v t (G + G") - Vj (G* + G'*) 

is satisfied, where all three games are to satisfy the condition that I(p) 
be non-negative for all p Q P. It is clear that this is an equivalence 
relation and that sums of equivalent games are equivalent. 

Two objections may be raised to this definition of game equiva¬ 
lence. First, it is not symmetric between the two players. Second, no 
effective procedure for determining whether two games are equivalent is 
apparent. Both of these objections will be removed by Theorem 1. 

Let -G denote the game G with players Interchanged so that 
Vj(-G) = v 2 (G) and I(-G) = 1 (G). The position corresponding to p In 
-G will be denoted by -p. Consider the game G + (-G), which may be 
abbreviated to G - G. Since the player who moves second can do at least 
as well as the first player by symmetrizing his moves, it follows that 
v 1 (G - G), v 2 (G - G) < 0 . Since I(G - G) > 0, It follows that 

( 5 ) v 1 (G - G) = v ? (G - G) = 0 . 

THEOREM 1. The following three conditions are 
equivalent. 

a) G~ G'. 

b) v 2 (G + G") = v 2 (G' + G") for all G' 1 . 

c) v 1 (G - G*) = v 2 (G - G') - 0 . 

It will first be shown that v ± (G + G") < v^G* + G**) for all 
G** if and only if v i (G - G‘) <0. Setting G'' = -G* in the first of 
these two inequalities we have 

v^G - G') < v i (G l - G*) == 0 . 

Conversely it follows by ( 3 ) and ( 5 ) that if v^(G - G 1 ) < 0 then 
v ± (G + G”) « v ± (G + G") - v 5 _ ± (G' - G f ) 

1 v ± ((G + G“) + (G r - G*)) - v ± ((G» + G*') + (G - G')) 

£ v ± (G' + G") + v 1 (G - G«) < v^G' + G") . 

The theorem follows from this assertion together with the 
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observation that v^(G - G*) - v^^G* “ G) • For example, if a) holds then 
v^G - G') < 0 and v^G' - G) = v 2 (G - G') (o. Since I(G - G') >0 
it follows that c) holds. 

A nontrivial example of two games which are equivalent is given 
by Figure 1 . In this diagram the positions are indicated by vertices, 
while the possible moves are indicated by arrows which are solid for 
player 1 and dotted for player 2. The payoff to player 1 is given. 



0 2 

Figure 1 


It follows from Theorem 1 that a game G is equivalent to the 
game zero (the game with one position and payoff zero) if and only if 

v 1 (G) = v 2 (G) = 0 . 

From equation ( 5 ) it follows that G - G ^0, so that -G is indeed an 
inverse to G. The equivalence classes of games therefore form an abelian 
group under addition. 

Several subgroups of this group are of interest. The symmetric 
games — games in which the role of the players is interchangeable -- are 
characterized by the equation G ^ -G or G + G **+ 0. In other words they 
form the subgroup of elements of order 2. 

Another subgroup consists of those games which satisfy 1 (G) * 0. 
The fact that these form a subgroup follows from the Inequalities ( 4 ) and 
the equation 1 (G) = I(-G)• It also follows from ( 4 ) that the factor group 
of games modulo games with incentive zero is a metric group under the 
metric I. The subgroup itself Is isomorphic to the real numbers under 
addition, the Isomorphism being provided by v^G) or v 2 (G). Suppose, 
for example, that the games G and G' satisfy 1 (G) - I(G') = 0 and 
Vj (G) - v 1 (G*). Then v 2 (G) = v 2 (G') - -v^G) and 



SUMS OP POSITIONAL GAMES 


297 


0 - v^G) - v 1 (G*) - v 1 (G) - V 2 (-G') i V^G - G*) 

< v 1 (G) + v 1 (-G') = v 1 (G) + v 2 (G‘) = 0 . 

Therefore v 1 (G - G 1 ) = 0 and similarly v 2 (G - G') = 0, which 
implies that G^G* • In particular G and G‘ are equivalent to the 
game with only one position in which 2 pays 1 the amount v 1 (G). 

The fundamental problem involved in the study of sums of games 
is that of describing optimal strategies for the sum of two or more games 
in terms of information about the individual games. Some information about 
this question will be given by Theorem 2, but a precise answer seems fairly 
difficult. 

It will frequently happen that the optimal moves in the sum of 
two games are not optimal In the individual games. An example of this is 
given in Figure 2. 



Figure 2 

THEOKEM 2. If the move p ] G M^p) is optimal 

for player 1 at some position p + p’, then 

V, (p) < V, (p,) 

and 

v 2 (p,) < v 2 (p) • 

Furthermore the position p' must satisfy 


V,(p) + VgCp,) £ I(p’) £ V,(p,) + v 2 (p) . 
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These inequalities are obtained by combining the equation 
v r (p + p 1 ) « -Vg(p^ p •) which states that p 1 + p* is an optimal move 
for 1 at the position p + p', with the inequalities (3) as applied to 
v, (p + p*) and v 2 (p 1 +p»). 

In order to gain some insight into the meaning of these in¬ 
equalities, several new definitions will be made. 

The loss function r^Pj/p) « v^p) + v 3 -i(Pi) measures the 
amount by which the move p 1 G M^p) fails to be optimal. Its fundamental 

property, which follows from (1) is r^Pj/p) > o where equality holds if 

and only if the move p 1 is optimal. 

The gain function g i (p 1 /p) ** v 3 -i(P) " v 3 -i^Pi) measures the 

amount by which the move p 1 G M^(p) is better than a pass. Its funda¬ 

mental property is 

gi^/p) i kp) 

where equality holds only for optimal moves. This follows from the 
equation 

S^Pt/p) = I(P) - ^(p/p) • 

A move p 1 + p* G M ± (p + p*) will be called sente 7 If 
I(Pj) > I(P’) • 

A sente move tends to force the opponent to reply in the same game. The 
quantity 

s^p^p') * Max (o, I(p') - I(p 1 )) 

measures the amount by which the move p 1 + p* GM^p + p*) fails to be 
sente. It is a non-negative quantity which vanishes only for sente moves. 
Using these three quantities we may rewrite Theorem 2 as follows. 

THEOREM 2*. If the. move p, +p' GM^p + p') is 
optimal then the following inequalities hold 

r^P,/?) 1 Min (I(p,), I(p’)) 

s,(p,,p') < g,(p,/p) . 

From the Japanese game Go. Pronounced sen-teh. 
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Roughly speaking, the first inequality says that a move which is 
non-qptimal in G can he optimal in G + G' only if it leads to a posi¬ 
tion of high incentive and if the game G' has high incentive. Apparently 
it is desirable to place the opponent in a position in which both games 
have high incentive, and it may be worth the sacrifice of a move which is 
not optimal in G in order to achieve this end. 

The second inequality says that a non-sente move can be optimal 
in G + G* only if it is much better than a pass, and even a sente move 
cannot be worse than a pass. 

The following inequalities describe the behavior of the loss and 
gain functions under the formation of sums of games. They are immediate 
consequences of (3) which are included only for completeness, since they 
will not be used in the sequel. 


r^p^p) - Min (Kp^, I(p')) 

r,(p,/p) + 3,(Pl' p,) - I(p) 


< r,(p, + p'/p + p') < r,(p,/p) + I(p') 


g^p/p) - I(P') 'j (" g,(P,/p) + I(P') 

V < g,( Pl + p'/p + p') < J 

g,(P,/p) - I(P) J l g 1 (P,/P> + I(P,) 

The following theorem gives a characterization of those moves in 
a game which can be optimal in some sum game. 


THEOREM 3- The following three conditions are 
equivalent. 

a) The move p 1 - p € M 1 (p - p) is optimal. 

b) The move p ] + p' G M,(p + p') is optimal for 

some p 1 . 

c) The move p 1 + p' 1 £ M 1 (p + p") satisfies 
g 1 (p 1 + p•*/P + P 1 ') ^0 for all p••. 

Setting p 1 = -p we have that a) implies b) . If p 1 + p* is 
optimal at p + p* then (p 1 + p ,f ) + (p 1 - p'*) is optimal at 
(p + P' 1 ) + (p* - p 1 ')’ Since p 1 + p*' is an optimal move in some sum 
game, it follows by Theorem 2' that it has non-negative gain. Therefore b) 
implies c). If p *' « -p then from c) we have 

0 i. gi<Pi - p/p - p) - v 2 (p - p) - V 2 (p, - p) - - V 2 (p, - p) < V,(p - p) - 0 

which shows that p 1 - p is optimal at p - p, and completes the proof. 
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The following may be described as a converse to (3). 

THEOREM h. If player 1 is to move at p + p*, 
and if he makes the first move in game G, then for 
any play of G + G* the payoff k 1 of this game will 
satisfy 

v,(p) + V,(p') - ^r 1 - < k, < v,(p) - v 2 (p') + D'p 2 + £s 2 

where the first two summations are taken over all moves 
made by 1 in this particular play, and the last two 

Q 

over all moves made by 2. 

Thus If player 1 can always make moves which are optimal in G 
or G* and sente, he will achieve the upper bound of v 1 (p) + v^p*) for 
his payoff. If 2 can always make optimal sente moves, he will achieve the 
lower bound of v 1 (p) - v 2 (p') (or -v 2 (p) + v^p’) if the first move is 
made in G f )- Since these two outcomes are usually incompatible, it follows 
that it is frequently impossible to make moves in G + G’ which are both 
optimal in G or G* and sente. 

Since proofs of these two inequalities are similar, only the 

first will be carried out. Suppose that player 1 makes the move 

p 1 + p* £ M 1 (p + p*) and 2 replies with the move p 2 + p£, where either 

p 1 = p 2 or p* = Pg« In the first case we have 

p l = P 2 » v 2 (p>) > - Vl (p-) , 

V,(p 2 ) + v,(p|) = v,(p,) + Vl (p') > v,(p,) - V 2 (p’) = 
v,(p) + V,(p') - r^p,/?) - (I(p') - I(p,)) . 

In the other case 


P' = V' 2 , v 2 (p,) > -V,(p 2 ), 

V,(p 2 ) + v,(p£) = V, (p 2 ) + v,(p') > -V 2 (p,) + Vl (p') => 
V,(p) + V,(p’) - r,(p,/p) - o . 


Q 

The condition that I be non-negative is not required for this theorem, 
which depends only on (i). 



SUMS OF POSITIONAL GAMES 


301 


Combining these two inequalities we have 

Vj(Pg) + V, (p-) > v,(p) + v,(p-) - r^p,/?) - 8,( Pl ,p') . 

Taking the corresponding inequalities for each move by player 1 in the play 
of the game, and combining them we have the required inequality. (If 
player 2 follows the strategies a) and b f ) of footnote 5, it is easily 
shown that equality holds in this expression. This provides an alternative 
proof of (3)•) 


J. W. Milnor 


Princeton University and 
The RAND Corporation 




Part IV 


GENERAL n-PERSON GAMES 


A one-person game can be converted easily into a maximization 
problem and hence is conceptually quite simple. The direct opposition of 
interests in a zero-sum two-person game leads to the minimax game-value, 
which is convincing both in its interpretation and in its mathematical 
rigor. But, once the game theorist leaves these well-explored areas for 
the uncharted territory of games‘with more than two participants or no 
constant-sum restriction, he has few bearings to guide him through the 
bewildering maze of paths open to him. The authors of the papers in Part 
IV attempt to throw light on known problems and to lead the reader into new 
approaches to the theory of general n-person games. 

Is it possible to appraise the equities of the participants in an 
arbitrary n-person game? (See Study 24, Preface, Problem 10.) In PAPER 17 
L. S. Shapley proposes a set of "values" which may be regarded as an 
a priori evaluation of the players' positions (or seats) in a game, ignoring 
totally any social structure or standard of behavior. His result can be 
interpreted by imagining thq random formation of a coalition of all of the 
players, starting with a single member and adding one player at a time. 

Each player is then assigned the advantage accruing to the coalition at the 
time of his admission. In this process of computing the expected value for 
an individual player all coalition formations are considered as equally 
likely. Shapley shows that there is just one evaluation which is additive 
with respect to the combination of independent games and which is such that 

4>1 + 't> 2 + ••• + 4> n “ A , 

where 4^ denotes the value assigned to player i * 1, 2, ..., n, and A 
the amount which the entire set of n players can obtain by cooperating. 

Still outstanding is the question, whether every n-person game has 
a solution in the sense of von Neumann and Morgens tern. (See Study 24, 
Preface, Problem 8.) However, Papers 18 , 19 and 20 introduce new classes 
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of n-person games for which solutions are obtained and employ methods which 
hold promise for further advance. Papers 18 and 19 deal with a class of 
games, termed "(n, k)-games,” that generalize the "direct majority game" 
of von Neumann and Morgenstern (see Theory of Games and Economic Behavior, 
p. **3l), while Paper 20 develops "quota games," a class of games that 
includes all constant-sum four-person games. 

The (n, k)-garae, introduced by R. Bott in PAPER 18 , is an 
n-person game in which any coalition of k or more players, for any fixed 
k > n/ 2 , wins one unit from each of its opponents and any smaller coali¬ 
tion is totally defeated. Here a coalition of exactly n-k+1 players is 
a "blocking coalition," since it is just large enough to keep its comple¬ 
ment from winning. Bott shows that the winning coalitions in a symmetric 
solution are composed of a number of blocking coalitions and that the 
members of any one blocking coalition within a winning coalition share 
equally in an imputation of the solution. Symmetric solutions are thus 
uniquely characterized. Dropping symmetry, D. B. Gillies exhibits in 
PAPER 19 a surprising variety of other solutions of (n, k)-games, all 
derived from Bott's symmetric solutions. Gillies' solutions are obtained 
by several methods which may carry over to a more general context: ( 1 ) by 

the addition of "bargaining curves" (Theory of Games and Economic Behavior, 
p. 501 ), (2) by inflation to larger games (ibid., p. 398 ), ( 3 ) by 
"discrimination" (ibid., pp. 288 - 289 ) in which the non-discriminated 
players divide their take according to any solution to a smaller game, or 
(4) by partitioning the players into fixed subsets, assigning the spoils 
arbitrarily (i.e. in all admissible ways in one solution) among these 
subsets, and then dividing the spoils in any one subset according to the 
symmetric solution to a smaller game the players think they are playing. 

Contrary to the (n, k)-games whose majority nature is readily 
described by verbal rules, the "quota games" introduced by L. S. Shapley in 
PAPER 20 stem from technical properties of the characteristic function v 
of von Neumann and Morgenstern. An n-person game is called a "quota game" 
if the amount A which the whole set of n players obtains by cooperating 
can be split among the n players 

A - ^ + <*> 2 + . • • + «u n 


so that 


w i + w j “ v ij for a11 i, j (i ^ j) , 

where v^j denotes the amount that the pair of distinct players i and j 
can obtain by cooperating. Shapley obtains families of solutions for the 
entire class of quota games, a class that contains some three-person games, 
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all constant-sum four-person games, and a sizeable swath of all games with 
more than four players. In a typical imputation in one of these solutions, 
all but two or three of the players receive their "quotas" c*^. 

In PAPER 21 H. Raiffa considers the challenging conceptual prob¬ 
lem of how one should choose an imputation from among the startlingly 
profuse solution sets of von Neumann and Morgens tern or from the equally 
abundant equilibrium points of Nash. He proposes "arbitration conventions" 
as a solution for generalized two-person games, l.e., two-person games in 
which the restrictions to a transferable utility and a common unit of 
measure have been dropped. To this end he represents the payoffs x and 
y to players I and II, which result from a pair of mixed strategies for 
the two players, as a point (x,y) in a Euclidean plane. The set R* of 
all payoff points (x,y) is extended to the minimal closed convex set R** 
containing R*. Reflecting the players* preferences in payoffs, a partial 
ordering of points is made;- 

(x,,y.,)-< (x 2 ,y 2 ) if x, < x 2 , y, < y 2 , and x., + y, < x 2 + y 2 , 

which leads to the subset of points of R** which are maximal with 

respect to the partial ordering. In terms of this graphical representa¬ 
tion, an "arbitration convention" is defined as a mapping T: R —> M^ 
that satisfies certain "natural" conditions. The mapping T, coupled with 
the Initial mapping of pairs of mixed strategies into payoff points (x,y), 
assigns to each pair of mixed strategies for the two players a preferred 
outcome In M^*, thus transforming the given game into a new game. 

Raiffa*s principal theorem asserts that saddlepoints always exist in this 
transformed game. Several examples of arbitration schemes especially 
suited to certain social structures are examined. 


H. W. K. 
A. W. T. 




A VALUE FOR n-PERSON GAMES 1 
L. S. Shapley 

4 1. INTRODUCTION 

At the foundation of the theory of games is the assumption that 
the players of a game can evaluate, in their utility scales, every "pros¬ 
pect" that might arise as a result of a play. In attempting to apply the 
theory to any field, one would normally expect to be permitted to include, 
in the class of "prospects," the prospect of having to play a game. The 
possibility of evaluating games is therefore of critical importance. So 
long as the theory is unable to assign values to the games typically found 
in application, only relatively simple situations -- where games do not 
depend on other games — will be susceptible to analysis and solution. 

In the finite theory of von Neumann and Morgenstern 2 difficulty 
in evaluation persists for the "essential" games, and for only those. In 
this note we deduce a value for the "essential" case and examine a number 
of its elementary properties. We proceed from a set of three axioms, 
having simple Intuitive Interpretations, which suffice to determine the 
value uniquely. 

Our present work, though mathematically self-contained. Is founded 
conceptually on the von Neumann-Morgenstern theory up to their introduction 
of characteristic functions. We thereby inherit certain important under¬ 
lying assumptions: (a) that utility Is objective and transferable; 

(b) that games are cooperative affairs; (c) that games, granting (a) and 
(b), are adequately represented by their characteristic functions. However, 
we are not committed to the assumptions regarding rational behavior embodied 
in the von Neumann-Morgenstern notion of "solution." 

We shall think of a "game" as a set of rules with specified 
players in the playing positions. The rules alone describe what we shall 


^he preparation of this paper was sponsored (in part) by the RAND 
Corporation. 

p 

Reference [ 3 ] at the end of this paper. Examples of infinite games with¬ 
out values may be found in [2], pp. 58 - 59 , and in [l], p. 110. See also 
Karlin [2], pp. 152 - 153 - 
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call an "abstract game.” Abstract games are played by roles -- such as 
"dealer," or "visiting team" — rather than by players external to the 
game. The theory of games deals mainly with abstract games.^ The dis¬ 
tinction will be useful in enabling us to state in a precise way that the 
value of a "game" depends only on its abstract properties. (Axiom 1 below). 

$ 2. DEFINITIONS 

Let U denote the universe of players, and define a game to be 
any superadditive set-function v from the subsets of U to the real 
numbers, thus: 

O) v(0) - o , 

( 2 ) v(S) > v(S fi T) + v(S - T) (all S, T C U) . 

A carrier of v is any set N C U with 

( 3 ) v(S) = v(N n S) (all S C U) . 

Any superset of a carrier of v Is again a carrier of v. The use of 

carriers obviates the usual classification of games according to the num¬ 
ber of players. The players outside any carrier have no direct influence 
on the play since they contribute nothing to any coalition. We shall 
restrict our attention to games which possess finite carriers. 

The sum ("superposition") of two games is again a game. Intui¬ 
tively it is the game obtained when two games, with independent rules but 
possibly overlapping sets of players, are regarded as one. If the games 
happen to possess disjunct carriers, then their sum is their "composition."^ 
Let TT(U) denote the set of permutations of U -- that is, the 

one to one mappings of U onto Itself. If ir e TKU), then, writing TTS 

for the image of S under IT, we may define the function itv by 

trv(trS) - v(S) (all SCU) . 

If v is a game, then the class of games ttv, 7 T G TT(U) , may be regarded 
as.the "abstract game" corresponding to v. Unlike composition, the opera¬ 
tion of addition of games can not be extended to abstract games. 


^An exception is found in the matter of symmetrizatlon (see for example [2], 
pp. 81 - 83 ), in which the players must be distinguished from their roles. 

^See t 31 , $$ 26.7*2 and .3. 
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By the value <|>[v] of the game v we shall mean a function 
which associates with each 1 in U a real number $^[v], and which 
satisfies the conditions of the following axioms. The value will thus 
provide an additive set-function (an Inessential game ) v : 

( 5 ) v(S) - Xs ♦itv] (all S C U) , 

to take the place of the superadditive function v. 

AXIOM 1 . For each ir in 7 T(U), 

•ffilirv] = t ± lv] . 

AXIOM 2. For each carrier N of v, 

^Iv] = v(N) . 

AXIOM 3 - For an,y two games v and w, 

(J)[v + w] = <J> [ v] + 4 >[w] . 

COMMENTS. The first axiom ("symmetry") states that the value is 
essentially a property of the abstract game. The second axiom ("efficien¬ 
cy") states that the value represents a distribution of the full yield of 
the game. This excludes, for example, the evaluation (JJ^Iv] = v((i)), in 
which each player pessimistically assumes that the rest will all cooperate 
against him. The third axiom ("law of aggregation") states that when two 
independent games are combined, their values must be added player by player 
This is a prime requisite for any evaluation scheme designed to be applied 
eventually to systems of Interd ependent games. 

It is remarkable that no further conditions are required to 
determine the value uniquely. 5 
• 

{ 3 • DETERMINATION OF THE VALUE FUNCTION 

LEMMA 1 • If N Is a finite carrier of v, then, 
for I t N, 


$ 1 [v] = 0 . 


^Three further properties of the value which might suggest themselves as 
suitable axioms will he proved as Lemma 1 and Corollaries i and 3 below. 
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PROOF. Take i ( N. Both N and Null) are carriers of v; 
and v(N) « v(N u (i)). Hence ^[v] - 0 by Axiom 2, as was to be shown. 

We first consider certain symmetric games. For any R C U, R / 0 
define v R : 

s 1 if S 2 R » 

(6) v R (S) - i 

0 if S £ R . 

The function cv R is a game, for any non-negative c, and R is a 
carrier. 

In whpt follows, we shall use r, s, n, ... for the numbers of 
elements in R, S, N, ... respectively. 


LEMMA 2. For c>0, 0<r<», we have 


*l tcV R ] 



if i £ R , 
if i ( R . 


1TR 


R 


PROOF, 
and TTi « 


Take i and j in R, and choose IT £ TT(U) so that 
j. Then we have irv R = v R , and hence, by Axiom 1, 


*.,[cv R ] = ^[cvg] . 


By Axiom 2, 


c - ov r (R) = X,6R tjtcvg] = r^tcvj,] , 

for any i £ R. This, with Lemma 1 , completes the proof. 

LEMMA 3 . 6 Any game with finite carrier is a 
linear combination of symmetric games v R : 

( 7 ) V - Xrcn c R< v > v fl ' 

RpO 

N being any finite carrier of v. The coefficients 
are independent of N, and are given by 


°The use of this lemma was suggested by H. Rogers. 
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(8) c R (v) -Stcr (- 1 ) r_t v(T) (0 < r < .) . 

PROOF. We must verify that 

( 9 ) v(S) - Srcn c R (v)v R (S> 

R?0 

holds for all S C U, and for any finite carrier N of v. If S C N, 
then (9) reduces, by (6) and (8), to 

v(S) - SrcS ^TCR tv ( T ) 


= y r y 3 

^TCS L -^r=t 


(-D 


r-t 


(rlt)] V < T > 


The expression in brackets vanishes except for s = t, so we are left with 
the identity v(S) « v(S). In general we have, by ( 3 ), 

v(S) = v(N n S) = Xrcn c R (v)v R (N A s > - Srcn c R (v)v R< S) • 

This completes the proof. 

REMARK. It is easily shown that c R (v) « 0 if R is not 
contained in every carrier of v. 

An immediate corollary to Axiom 3 is that $[v-w] = <J)[v] - <t>[w] 
if v, w, and v - w are all games. We can therefore apply Lemma 2 to 
the representation of Lemma 3 and obtain the formula: 

(10) 4 > ± [v] =Xrcn c r( v )/ p (all 1 € N) . 

Rli 

Inserting (8) and sinplifying the result gives us 


( 11 ) 


<Mv] 


<SCN 

S 3 i 


(s-1)i(n-s) 


vfSI - y s . i (. n! 


v(S) 


S^i 


(all i 6 N) 


Introducing the quantities 


( 12 ) 


r n (s) - (S-1)J(n-s) i/ni , 


we now assert: 


THEOREM. A unique value function $ exists 
satisfying Axioms 1 - 3 , for games with finite carriers; 
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it is given by the formula 

( 13 ) , $ ± [v] “Sscn r n (s)Cv(S) - v ( s -( 1 ))l ( a H 1 6 U) , 

where N is any finite carrier of v. 

PROOF. (13) follows from (ll), (12 ), and Lemma 1. We note that 
( 13 ), like (10), does not depend on the particular finite carrier N; the 
of the theorem is therefore well defined. By its derivation it is 
clearly the only value function which could satisfy the axioms. That it 
does in fact satisfy the axioms is easily verified with the aid of Lemma 3. 

J 4 . ELEMENTARY PROPERTIES OF THE VALUE 

COROLLARY 1 . We have 


0*0 <t> ± [v] > v( (1)) (all in), 

with equality if and only if i is a dummy -- i.e., 
if and only if 

( 15 ) v(S) = v(S - (i)) + v( (i)) (all S 3 i) . 

PROOF. For any i G U we may take N 3 i and obtain, by (2), 

4>l[v] > DsCN ' 

S¥i 


with equality if and only if (15), 
proof is completed by noting that 

(16) ^SCN V s) = ^a=l ( 

S 3 i 


since none of the r n (s) 

S:1) V) - i -' 


vanishes. 


The 


Only in this corollary have our results depended on the super¬ 
additive nature of the functions v. 


COROLLARY 2. If 
games w^, w^ , .. 
carriers N^, N^, 


v is decomposable — i.e., if 
, w^ having pairwise disjunct 
..., exist such that 



w(» 


V 
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— then, for each k ® 1, 2, 

•^[v] - <t> 1 [w (k) ] (all 1 6 N (k) ) . 

PROOF. By Axiom 3 - 

COROLLARY 3 * If v and w are strategically 
equivalent -- i.e., if 


(17) w = cv + a , 

where c is a positive constant and a an additive 

7 

set-function on U with finite carrier -- then 

^[v] = c^v] + a( (i)) (all iGU) . 

PROOF- By Axiom 3 , Corollary 1 applied to the inessential game 
a, and the fact that (13) is linear and homogeneous in v. 

COROLLARY h. If v is constant-sum -- i.e., if 

(18) v(S) + v(U - S) = v(U) (all S C U) , 

— then its value is given by the formula: 

( 19 ) ^tv] = 2 [S S c N * n (s)v(S) ] - v(N) (all 1 C N) - 

S 3 l 

where N is any finite carrier of v. 


PROOF 

. We have, for i 

£ N, 

^[v] 

~ ^SCN 

«’ n (s)v(S) 

“ StcN 


S 3 i 


T^i 


“ ^SCN 

» n (s)v(S) 

- Sscn * n ( n “ s+1 )[v(N) " v(S)] 


Sii 


S?i 


But lf n (n-s+l) = f n (s)s hence (18) follows with the aid of (16). 


7 This is McKinsey's "3-equivalence" (see (2), p. 120), wider than the 
"strategic equivalence" of von Neumann and Morgenstern ([ 3 ], f 27*1 )• 
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$ 3 . EXAMPLES 

If N is a finite carrier of v, let A denote the set of 
n-vectors (<< 1 ) satisfying 

( Su'S. " v(N) * 

V 'I v((l)) (all 1 6 N) . 

If' v is inessential A is a single point; otherwise A is a regular 
simplex of dimension n - 1. The value of v may be regarded as a point 
$ in A, by Axiom 2 and Corollary 1 . Denote the centroid of A by e: 

- v((l)) + i [ v(N) - Xj GN v((j))] . 

EXAMPLE 1. For two-person games, three-person constant-sum games, 
and inessential games, we have 

(20) 0 « 0 . 

The same holds for arbitrary symmetric games — i.e., games which are 
invariant under a transitive group of permutations of N — and, most 
generally, games strategically equivalent to them. These results are 
demanded by symmetry, and do not depend on Axiom 3. 

EXAMPLE 2. For general three-person games the positions taken 
by 0 in A cover a regular hexagon, touching the boundary at the mid¬ 
point of each 1-dimensional face (see figure). The latter cases are of 
course the decomposable games, with one player a dummy. 



EXAMPLE 3- The quota games 8 are characterized by the existence 


^Discussed in [4]. 
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of constants ^ satisfying 


u i + “j * 
^N W i “ v(N) ■ 


For n * 3 , we have 


( 21 ) 


<D - 


e 


(O-Q 

2 


(all i, j 6 N, j) 


Since u> can assume any position in A, the range of $ is a triangle, 
inscribed in the hexagon of the preceding example (see the figure). 

EXAMPLE 4. All four-person constant-sum games are quota games. 
For them we have 

( 22 ) ♦ - « - • 

\ 

Q 

The quota <*> ranges over a certain cube, containing A. The value $ 
meanwhile ranges over a parallel, inscribed cube, touching the boundary of 
A at the midpoint of each 2 -dimensional face. In higher quota games the 
points $ and u> are not so directly related. 

EXAMPLE 5. The weighted majority games 10 are characterized by 
the existence of "weights" w i such that never 23 ^ = 6111(1 

such that 



r v(S) = n - s 

if 

S 3 W 1 > Sn-S 

W 1 ’ 



( v(S) = - s 

If 

2 s w i ^ ^N-S 

W i • 


The game is 

shown that 

then denoted by the symbol 

tV W 2’ •••» 

v- 

It la eaaily 

( 23 ) 

♦i< *3 

implies w i < Wj 

(all 

1, i 6 N) 


in any weighted majority game [w^, v 2 , ..., w n ). Hence "weight" and 
"value" rank the players in the same order. 

The exact values can be computed without difficulty for particular 
cases. We have 


^Illustrated in [4], figure 1 (page 353 in this volume). 
10 See [3], ♦ 50.1. 
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- § 5 ^ ( “ 1 * -1 > • • • > - 1 > n “ 1 ) 

for the game [1, 1, ..., l, n-2], 11 and 

♦ - f 0, i, i. -1, -1, -1) 

for the game [2, 2, 2, 1, i, i], 12 etc. 

$ 6. DERIVATION OP THE VALUE PROM A BARGAINING MODEL 

The deductive approach of the earlier sections has failed to 
suggest a bargaining procedure which would produce the value of the game 
as the (expected) outcome. We conclude this paper with a description of 
such a procedure. The form of our model, with its chance move, lends 
support to the view that the value is best regarded as an a priori assess¬ 
ment of the situation, based on either ignorance or disregard of the^ social 
organization of the players. 

The players constituting a finite carrier N agree to play the 
game v in a grand coalition, formed in the following way: 1. Starting 
with a single member, the coalition adds one player at a time until every¬ 
one has been admitted. 2. The order in which the players are to join is 
determined by chance, with all arrangements equally probable. 3* Each 
player, on his admission, demands and is promised the amount which his 
adherence contributes to the value of the coalition (as determined by the 
function v) . The grand coalition then plays the game "efficiently” so as 
to obtain the amount v(N) — exactly enough to meet all the promises. 

The expectations under this scheme are easily worked out. Let 
T^ be the set of players preceding i. For any S 9 i, the payment to 
i if S - (i) - T^' is v(S) - v(S - (i)), and the probability of that 
contingency is y n (s). The total expectation of i is therefore just his 
value, (13), as was to be shown. 


1 discussed at length in (3), $ 55- 
1 discussed in [3], { 53-2.2. 
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SYMMETRIC SOLUTIONS TO MAJORITY GAMES 1 
Raoul Bott 

The purpose of this note is the determination of all symmetric 
solutions to a family of n-person games [I]. 2 A game (n,k) in this 
class is defined by the value of the game v(S) for all coalitions S. 

If |S| is the number of players in S, then 

f - |S| for |S| < k 
v(S) = J 

[ n - |S) for |S| > k 

where k is a fixed Integer with ^ < k < n. 

This means that a coalition of k or more players can obtain the 
maximum possible amount, and a-smaller coalition is totally defeated. An 
(n-k+1)-player coalition is the smallest coalition which is large enough to 
block Its complement from winning. Such a coalition, if its members act 
together, must be Included In the final (winning) coalition, so we might 
expect that a number of these "blocking coalitions" would combine to defeat 
the remaining players, and that all members of a particular blocking coali¬ 
tion would receive the same amount in an imputation of the solution. The 
systematic theory will confirm this, and will show that this is the unique 
symmetric standard of behavior. This uniqueness Is, however, completely 
lost when the condition of symmetry is dropped. Mr. D- B. Gillies has 
found an alarming number of unsymmetric solutions to these games, most of 
which could not be intuitively anticipated at all. 

The game (n,k) Is zero sum only if k = ■— , and in this 

case (n,k) is the n-person simple majority game. For k > - ■ * - ■ , there 
exist pairs of opposing coalitions, both completely defeated, so the games 
are non-zero sum. These form the symmetric generalization of simple games: 
every set Is either winning or losing, but the game need not be zero sum. 


*The preparation of this paper was supported by the Office of Naval 
Research. 

2 Numbers in square brackets refer to the bibliography at the end of this 
paper. 
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A symmetric solution V contains all imputations arising from 
permutations of the indices of any imputation a £ V, and is therefore 
characterized by its "ordered inputations" (a|a G V, a.j < a 2 < ... < a n ). 
a £-b via S means 


a ± > for iCS, and |S| > k . 


If |S| > k, we can find a subset T of S with |T| « k, and a £-b 
via T, since all k-person sets are effective. 5 Since V is symmetric, 
we may assume without loss in generality, for a £ V, that the largest k 
components of a majorize the smallest k components of b. These remarks 
apply, of course, whenever a is a member of a symmetric subset of imputa¬ 
tions, and we are deciding whether or not at least one member of this sub¬ 
set dominates b. This leaus to the following redefinition of the concept 
of domination. 

Let A be the simplex of ordered imputations in Euclidean 
n-space E n , defined by 


( 1 ) 


a i < a i +l 


(2) a, > -1 

(3) 2? a i ‘ 0 
Then domination (£-) is defined by 

a fc-b if and only if a n-k+y > b y for Y = 1, 2, ..., k . 


Since all our proofs require that the dominating imputation be in a sym¬ 
metric subset of imputations, b can be assumed ordered without loss in 
generality, and proofs can be constructed relative to A by means of the 
above definition. 


THEOREM. Let p - n - k + 1, and write n = 
sp + r, where o < r < p. Let V C A be the simplex 
of points a £ A with the following properties. 

(*> 

( 5 ) 


a 1 « -l if r ^ o . 

& r+1 ~ a r+*+i » lf M o ")od p . 


^This is proved in [1], p. 439: (49:J). 
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Then V is the unique solution in A. 

PROOF* We break up the proof of this result into a sequence of 

lemmas. 

LEMMA 1 . Let W C A consist of all points a 
such that a r+y - a r+y+1 , 4 0 mod P- Then a solution 

V of A must certainly be contained in W. 

PROOF. Suppose a £ V where V is a solution in A, and sup¬ 
pose a^ < a^ +1 for k < 1 Q < n. Let a be given by 
± o o 

a I = a i + e • 1 t L o + 1 
a* Q+1 = a^ +1 - (n - 1)£ , 

where £ > 0 Is so small that a* < a* +1 . Since a* £- a, and hence 
cannot be in V, there exists ° ° b Q V nominating a , and we 

have b 1+n _ k > a* (i = 1, 2, ..., k). But for i < k < i Q + 1, a* > a ± , 
so b 9-a, a contradiction. Thus the last p coordinates of an element 
in V must be equal. Next assume a G V anu < a i +1 , 

n-2p+ 1<i Q <n-p + 1. Define a as o u before. Again 

there exists b G V with b £-a , and b i+n _ k > a i (i - 1, ..., k) . Now 
a* > a^ except for possibly i i Q + 1 . But by our previous result, 
since b G V, we l*ave 

b i o +1+n-K = b i 0 +2+n-k 

Now a i 0+ 1 < a l 0+ 2 < a i 0+ 2 < b i o+ 2 + n-k = b i 0 +n-k+1 ’ 30 b *- a also - 
Therefore the second block uf p components of a must all be equal. The 
proof now proceeds by induction in a straightforward manner. 

LEMMA 2. Any solution in A contains all imputa¬ 
tions in W with a 1 = -1 if r / o. 

PROOF. A general imputation in W is of the form 

a “ f *o* S' •••' S' S' S' S' •••' 0l 2' "•'S' •••' S ] 

and from our definition of domination we have, for imputations a, a* GW: 
a £-a* if ana only if for i ~ 1 , 2 , ..., 


s . 
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Hence 

(6) • 

But since 

X? a ± “ 0 - a i » 

we have 

(7) + r Si ‘k “ d o + r Si* *1 for r ^ 0 • 

Combining (6) and (7) we obtain oCq < ct^ which is Impossible if - -1. 
Hence V contains all imputations with a 1 - - -1. 

We have now shown two things: 

(1) The set V defined by our theorem is satisfactory, that is, 
for a, b G V we cannot have a £-b. 

(2) V is contained in every symmetric solution. 

The proof that there exists an imputation a G V dominating any 
imputation in A - V will show that V is a solution, and that it is 
unique since no superset of a solution is a solution. 

LEMMA 3- For b G A, there exists an a G V 
tfith a^b, unless b G V. 

PROOF. The required imputation a is specified by the quantities 
otj, otg, .ctg which must satisfy 

(8) p ol ± « r (since 2)a ± - 0) . 

<9) > b r +(i-l)p+1 for 1 = 1. 2, .... s 

(by the definition of domination). 

Summing (9) over i, and substituting in (8) we obtain 

p Si b r+(i-1)p+l ^ r ' 

which is sufficient as well as necessary. But since b^ < b i+1 we have 

p Si-l^r+(i-l)p+l “ Si»l pb r+(i-l )p+l 1 Si*l (Sr£l b r+(i-l )p+*) " " Si-l b i* 

. How - £* ^ < r since b^^ > -1, with equality only if 
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-1 - bj «b 2 « ... “b p . The other Inequality becomes equality only if 
br+(I- 1 )pvl " b r+ip for 1 1 1 ( 3 v^Ich defines an imputation in V. 
Hence unless b € V we can solve ( 8 ), ( 9 ) and dominate b. 

This completes the proof of the theorem. As mentioned earlier, 
this unique solution V is entirely in accordance with our intuitive 
expectation. The ,f p-coalitions" turn out to be the bargaining units of 
this game. Further, their bargaining is entirely "free" except of course 
that they will between them completely exploit the defeated r players 
which are left over after the maximum possible number of p-coalition 
receives the same amount. 

In the zero-sum case (n, n —| 1 ) the solution consists of a 
finite set of imputations, formed by permuting the Indices of the imputa¬ 
tion (“1* — 1 9 • • * » ”1 1 rT""+ r 9 n + 1 9 * * * 9 n + T^ * This Is the main 
solution to the simple majority game in n players. For k > n ^ 1 , the 
symmetric solution consists of an Infinity of imputations. 

BIBLIOGRAPHY 

[ 1 ] von NEUMANN, J. and MORGENSTERN, 0., Theory of Games and Economic 
Behavior, Princeton 1944, 2 nd ed. 1947. 
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DISCRIMINATORY AND BARGAINING SOLUTIONS 
TO A CLASS OP SYMMETRIC n-PERSON GAMES 1 

D. B. Gillies 

The application of game theory to economics ana sociology awaits 
a general theory of n-person games. As yet, methods have not been found 
for determining solutions to all n-person games; nor is it known whether 
every game has a solution. The intensive study of a particular class of 
games provides empirical data on the nature of solutions, methods which may 
be applied to other games, and may suggest or disprove conjectures on solu¬ 
tions in general. 

R. Bott defines the family (n,k) of n-person games in [I], 2 and 
determines for each game the unique symmetric solution. All unsymmetric 
solutions found in this paper can be related to symmetric solutions (to 
possibly different games of the class) by the systematic use of four de¬ 
vices. We shall study these devices in detail. 

(1) Certain symmetric solutions may be modified by the addition * 
of arbitrary functions -- the so-called "bargaining curves'* ([2], p. 501) 
which exist for an infinity of these games. 

(2) A new type of discrimination occurs. A group of players may 

receive a variable amount, but be required to divide it in accordance with 
the symmetric solution to a smaller game. For example, the game (^, 3 ) has 
a solution consisting of all imputations: (z, -1, and permuta¬ 

tions of the last 3 components for all z in -l < z < 3. That is, player 
(1) receives some admissible amount z, and the balance is divided in 
accordance with the symmetric solution to the game (3>2). 

(3) Any solution to (n,k) may be inflated ([2], p. 398) to a 
solution to (n+t,k) by assigning the t additional players fixed amounts, 
(provided these amounts are not too large, and provided both games are in 
the class). These are the "discriminatory" solutions ([2], pp. 288 - 289 ). 

(4) The fixed amounts in (3) are subject to strict inequalities. 


^The preparation of this paper was supported by the Office of Naval 
Research. 

2 Numbers in square brackets refer to the bibliography at the end of this 
paper. 
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In some cases one or more equalities are permissible if imputations are 
added and subtracted from the set, and a new solution obtains. 

DEFINITION. The symbol (n,k) denotes an n-person 
game whose value v(S) for a coalition S, numbering 
IS| players, is 

k 

> k, where n > k > ^ . 

every imputation related by a permu- 
a' 53 (aj, q> 2 $ ••• 9 a^) with 

i ^ r (mod p) 

> o , 

where p = n - k + 1, n*sp + r, o<r<p. 

That is, a G V n k means that relative to a there exist s 
sets of players, each set of size p; the players in any one set receiving 
the same amount in a. The r players not included in these sets each 
receive -1. 

Bott shows that domination is equivalent to domination via a 
k-element set, and that all k-element sets are effective. We shall there¬ 
fore consider only k-element sets in our proofs. A solution V is sym¬ 
metric over a subset S of components if it is left invariant by any 
permutation of these components. For such a solution, we may renumber the 
S-components of a general imputation, since domination of this new imputa¬ 
tion implies, by symmetry, domination of the original one. 

It is desirable to include also the games (n,n) in our class. 
For these, only n-person sets are effective, and the unique solution con¬ 
tains all imputations. (This agrees with the formula for V n n ). 

i 1 . SOLUTIONS WITH BARGAINING 
The symmetric solution to (n,k), V n k , can be defined as 

follows: 

An imputation a is in V n ^ if and only if there exist s 
numbers where -1 < ^ < ... < * 3 , and s+1 disjunct index 

sets S Q , Sj, ..., S g such that 


v(S) 


- |S| for S < 
n - |S| for S 


The symmetric solution V n ^ contains 
tation of components to an imputation 


a i = a i+i for 


af «• -1 for r 
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( 1 ) 


|S 0 I - r 


I S i | - p If i^O 


( 2 ) 

( 3 ) 


If a= (a,, a n ) then a y = 


P 21=1 *i - r • 


-1 if 

V6 S Q 

if 

ve 3 ± 


Let r = 0. S Q is empty and V^ 1 a y = p 2? d i = 0 - Let 
(qyK,, ..., oC s )} be n functions defined for every a Q V R k (r * 0), 
for which 


(D q y («V * s ) + > -1 

( 2 ) Xv=r q v (oC i’ •••» * s ) = 0 ' 

These lnply, for ot >1 = -1, that q v (ot 1 , ..., d . q ) = o for V = 

1, 2, ..., n. Given a, define a vector q(a) - (q y (a)} = 

(q v (dL., * •••a d s ) + a v ) • The conditions above are necessary and sufficient 
for q(a) to be an imputation. Define V n = (q(a) | a G V_ J. We con- 
sider additional conditions on the functions q to ensure that Vq is a 
solution to (n,k). 

DEFINITION. Two imputations a,a G V n k will be 
called essentially different if they do not differ by 
just a permutation of components, that is, if 

o6 L ± for some i . 

THEOREM. A sufficient condition that V q be a 
solution is that for any two essentially different impu¬ 
tation a, a £ V n k we have 

lqy(*,, * 2 , otg) - qyCaC,, * 2 » •••» * s )l< iTf I** - *j_l • 

PROOF. We first show that no imputation in V q dominates 
another. Assume the contrary, then q(a) £~q(a), that is, 
qyfoL^ c^) + a v > q (*,, ..., i s ) + a v for some index set of size k. 
This inequality fails for at most n-k * p-l indices. If a,a are not 
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essentially different, q- q v (<*,, and a{-a, 

a contradiction. Otherwise we show that there exists an i - i such that 

^l o - * 1q > lq v (<*,. •••, «g - q v (^, .... i s )l 

y ' •••> etg) • <!„(«*■! » •••> °tg) • 

If max 15^ - ot^l occurs for i 1 , then either > o, in which 

case 1 i Q * i 1 , or 11 

^i^I, ®i " “ **1, " *1, y (s-1)|q v (ot) - q v (£)l • 

Hence for some 1 = i , <*, - e(. > |q (<*,) - q (o() | . 

_oo v y 

But q y (ol) + > q^ol) + otj implies 

<Ij - \< lq v (*) - q v (<£) I • 

For i « j « i we have seen that this fails (for any y). Hence for 

j > i Q , i < i Q it fails a fortiori. That is, for j > i Q , a necessary 
condition for the inequality to hold Is i > i Q . So for the (s - i Q + l)p 
components (v|a v > 3^ } we can have at most (s-i Q )p inequalities 
satisfied: (V|a v )> . Thus the Inequality fails for at least p 

components and 0 q(a) ^-q(a). Hence V q is a satisfactory set. 

To show that any b $ V q Is dominated by some q(a) G V q , we 
consider separately the cases s = 2, s > 2. 

Suppose s = 2, then - = + <* 2 = jS say, where 0 < £ < 1 . 

Suppose b is an imputation which Is not dominated by any q(a) G V q . We 
obtain a contradiction. Define index sets 

T,(f) = (v|q y (f>) + 8 < b v ) 

T 2 (p) = (V|q v (^) + /J > b v > q y (p) - p) 

T 3 (p) = (V|q y O) - p > h v ) • 

For P / p*. |q v (p) - q Y (p*) I < IP - (S* I ao T, ,T ? are monotone non-ln- 
creasing sets. Suppose Tj(fi) Is empty for all f>, Including f> - o. 

Then q v (0) « by and b G V^. Otherwise let £ be the smallest £ for 
which T 5 (p) Is empty (it Is certainly empty at (3 = l). For < 5, 

|T 1 (^)| > p, for otherwise q(a) b, where 
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Q v (a) 


r q v O) -ft for V = V Q G T 5 (ft) 

-< qy(ft) + ft for P other indices in T 2 +T^ 
q v (ft) - ft otherwise . 


But |(ft) | is continuous on the left, so jT^ft)! > p. Let S be a 
p-element set C T 1 (ft) and define 


q v (a) = q v (ft) + ft for V G S 
- < 3 V (A) - otherwise . 

Then always q y (a) < b y so q(a) = b G V q , the required contradiction. 

For s > 2, the proof that any imputation is dominated unless it 
is in the solution, is patterned after an alternative proof for the symmetric 
solution which we give in detail for the case r = 0. 

Let b be any imputation, (Indexed such that b 1 < b 2 < ... < b ). 

Define dj_ - £ S (i_i) p+ i )p+i» ulth e< J uallt y onl y all *>j 

in the sum are equal. Let a be the imputation in V n k defined by 

i i - *1 

*1+(l-2)p+K = *1 lf 1 i * i P 

ij = 5 , 11 j > k . 

Then a j > bj for the first k indices, unless one or more of the sums 
are over equal by However not all such sums can consist of equal elements 
(or b 6 V n<k ) so there Is one, say > b^ 

Let d^ = b(i _j)p +1 + 3 £» °where ° £ > 0, and define 
*-<*,, • ••, <*g)° by °" 

r = *■> - (S- 1 )£ for 1 = i 

*1 J 

** + t otherwise . 

Then a defined as above, from d, satisfies a fc-b, and & ^ k* 

This completes the proof. 

If s > 2, b $ V q , define a vector function y(^) = 

(b,,-q,, («L), b 2 ,-q 2 , (d.), •••, b n ,-q n , (<*.)) where (1’,2>, lathe 

permutation of ( 1 , 2, .... n) such that Y, (a.) < Y 2 (d) < ... < Y n (d) - 
(This permutation la a function of d, but the y y (d) are continuous, and 
satisfy |Y v (d) - Y v (d) | < Uy iu ax |d ± - for d fL d .) 
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Define a vector function 0(d) by 

. s - 

Then - 0 and lO^d) - ^(51)1 < ~y max Ic^ - dj for o 

By analogy with the previous proof, ve solve the * vector equation 
0(d) = d, if possible. 

We shall form a sequence ol°, d 1 , ol 2 > • •• where d 1 * 1 * (Kd 1 ) 
and show that it is a Cauchy sequence. Its limit, d, satisfies 0(d) = SC, 
since f is a continuous function. However (Md 1 ) is defined only when 
d* can arise from some imputation in V n k so we must guarantee that 
d 3 ^ 1 > - 1. (Since 20j(d) - o, we have °) • 

Define d 0 ,*? by: 

*i m P 2?j-1 )p+l b k 


n 1 * +1 

+ -~T fop i/i 1 

Then 0 * ~ X\ = = X*°y and d] > -1 • But d° - - 1 , so q y (d°) = 

0 , and from the definition of $ we have 0(d°) = d 1 . Similarly if d! = 

-1, d * 0(d ) = oL and we have the solution d « oC . Assume then dj > -1, 
or 1 + «] > o. Let » max let 1 * 1 - <*. k | . Then /u Q - d] + 1 > 0 . Suppose 
dJj > -1 for 1 < j < i. k Then 

= max let 1 * 1 - 4 l 

= max l^oC 1 ) - (t> k (<*. i " 1 ') 

< ( 5 ^-) max |<i k - ot 1 ^ 1 I 

< (sTf) ^i -1 • 

Hence 

Pi< ■ 


, . -1+1 + «t{ + (*2 - *]) + (cl* - 0 ^ 2 ) + ... + (ot .l+1 _*!) 


> -1 + (1 + *]) - |*t2 - «.]| - |et.3 -ot^| - ... 


I* 


i+1 


*ii 


But 
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> -1 + * >*i ‘ >*2 “ * • • " >*i 

> - 1 + »*o - ^o ( i^T + ( ¥TT )2 + ••• + (iTf) 1 ) > - 1 + ho - <1^0 

> -! + > -l» since y- 0 > o, s > 2 . 


Hence > -1 

and ol 1 is 

defined for all i. 

Similarly 


\4 - 

/ In 1 -i 1+1 I 

S ! *k " 01 k 1 

1 A !^ 1+1 .I+ 2 1 , 

I + |oL k - cL k | + 

+ 

i 

.i+m 


< ll (-M 1 • — • 

2 . Mb's-V 3-2 


|<*.£ - cC 1 £ nl l —■> 0 as i —■> <x>, and M. 1 ) is a Cauchy sequence, vho3e 
limit, 5, satisfies 

“S > - 1 

2*1 - 0 
$ (51) = 5L . 

For this oL, we renumber the Indices of b relative to a 
permutation (1», 2', n') which makes Y^C**) monotone. Then 

Yy(ct) — by - t °^*2 * • * * * ^ b v+1 ” q V+1 ^1 * * * * 9 f*or 

V = 1 , 2 , n-1 . If Yd.Dp+T - Yip (for i = 1, 2, s), 

then b G Vq since t (i_ 1 )p+r = °*i + 9(1-1)p+tf (<*! * 

(1 < IT < p, 1 < i < s). Otherwise, for some 1 = i Q 

Y(i 0 - i)p+i + s£= <* ± with E > o . 

Then define 


^ - (s-1) £ for i = i Q 

o 

= + £ for 1 / 1 0 • 

Then q(a) £-b, q(a) G V q , where q(a) is defined by 
q/a) - q,e^) + <*, 

q l + (i-2)p+>r ^ “ q l + (i-2)p+r (0 S* 'V + ^i 
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for 1 < t < p and 2 < i < s 

q v (a) - q y (ot 1 , ..., cL g ) + for V > (s-1 )p+1) - k . 

PROOF. We show that domination is via the set (1, 2, ..., k). 
Suppose q 1 + (1 _ 2 ) p+ f(«*-,, •••, <*- a ) + ^ < b-, (i_ 2 ) p+ «- for sonie index 

1 + (i-2)p + r with 1 < y < p. Since 

,<3 1 + (l-2)p+» (o( -1 ' •••' ■ q i + (i-2)p+!f (S 1 * •••» <*3>l < sir ““ l ol -l-4jLl = £ 

the left side is > Qi + (i-2)p+y' •••> ” £* Transposing, we have 

*1 - *< T t+{w)H fi) < %-,)p + ,<*> • 

For i ^ i Q , oL^ - £ = 6^ so we obtain a contradiction. If i = i Q , 

- £ = oL^ - st = -l)p+l® which again gives a contradiction. Hence 

q^(a) > by for y < k? This completes the proof of the theorem. 

REMARKS 

(1) The presence of arbitrary functions q v (<*0 in the solution 
bears a resemblance to situations in economics where bargaining occurs. 

(2) For s = 2, the proof can be strengthened to the case 
|q v (A) - Qy(A*)| < | A - A* \, and it is probable that equality is per¬ 
missible in the Lipschitz condition for s > 2 also, although this cannot 
be shown by means of a Cauchy sequence. 

(3) For r ^ 0 I have not found bargaining solutions of full 
dimension, although a smaller game can often be found whose bargaining 
solution can be inflated to solve the larger game. In one case: 

(2p - 1, p) there are certainly no bargaining solutions of full dimension: 
this is the zero-sum case — the direct majority game which is a particular 
case of a simple game. In a simple game, either a set S or its comple¬ 
ment is always effective, so two imputations in a solution must have at 
least one equal component . 

f 2. A NEW TYPE OF DISCRIMINATION 

LEMMA. If V is a solution to an n-person game, 
and b - (b 1 , b 2 , ..., b R ) is a vector satisfying 
b^ > -1 for 1 - l, 2, ..., n and 
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then there exists an imputation a G V with a^-b. 

PROOF. Define E by « b^ + £, i « l, 2, ..., n, where 

£ - H > 0 • 

Then E is an imputation. If E < V there exists a G V with a E, 
and* a £-b a fortiori. If E G V, then E fc-b via the effective set I 
of all n players. The symmetric solution V n k to (n,k), has a very 
interesting property if r = p-1, in the light of this lemma. There are 
p-1 components which are -1, so given any vector b satisfying the 
conditions of the lemma, we can never have, for a ^ v n ^ : a i ^ b i for 
more than k Indices. The transformation T(X) : a —> a(X) defined by 
a ± —> a i (1 + ^) + n ' I = 1 > 2, ...,n has the properties 

(1) a i = -1 implies a i (X) = -1 

(2) If X > -n, a 1 > aj^ > -1 implies a^X) > a^(X) > -1, 
with equality in the transforms only if X = -n. 

(3) ]£l=l a 1 (X) = X + (1 + *) 5)" (= X if a ± - 0). 

(4) If T(X) is applied to all imputations a e v n the 
image V n k (X) is a solution to the strategically equiva¬ 
lent game defined by v(I) = -X : 

r - |S| if |S| < k 
v(S) = J 

n - X - |S| if IS| > k, where X > n . 


If (n 1 ,k 1 ) (n 2 ,k 2 ) are 2 games with = p ] - 1 = n 1 - k 1 

and if (V , V n k ) is the set of imputations (a,b) 

, n g ,K 2 


+ n 2 )-dimensional space where 


a * v k ; 

n i 


> r 2 - n 2 - k 2 , 
in an 

we might expect 


( v n k (X), 

n 1 ,K l 

+ n 2 , k 1 


V , (-X)), - n. < X < n p , to be a solution to the game 
n 2 , k 2 * — — < - 

+ kg) . We prove a more general theorem: 


THEOREM. Let (n^k,), (n 2 ,k 2 ), ..., (n g ,k g ) be 
g games satisfying the conditions - n ± - k^ * p ± - 1 
for i = l, 2, ..., g. Let A be the space of imputa¬ 
tions for the (%f n ± ) -player game (n, + ... + n g , 
k 1 + ••• + k g ), and let , ..., S g be g fixed index 
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sets for A with 

|S 1 1 - n ± 

S ± n Sj - the null set . 

Number the indices in with the same in- 

dices as 3^ (i » 1, 2, ..., gr in some order. If 

V-{a(X) - (a](X|), .... a®(Xg)) I a 1 C 1- 1, 2, .... g ; 

X i “ n i and S f X i “ 0 } 

then V is a solution to (n,k) = ( X SJk^). 

PROOF. We have seen that domination means domination relative 
to (n^k^) for every index set S^, and also that there exists 

a*(X) £ V_ v (X) dominating any extended imputation b with 
n i ,K I 

2j € g bj < X ± . Suppose a(X) £-a(Y) and a(X), a(Y) £ V. Now 

Xf Y i* Then for some i - i Q , X ± < Y ± . Then 

a °(X i ) {^-a °(Y i ), so the relation a^X) > a^(Y) can hold for at most 

Xtf± k i + < k i -D * 2k ± -1 indices. Hence a(X) ^a(Y). Given b $ V, 
we °determine° ^ b j* ^or at least one "subgame" S i we have 

a °(X^ ) £-b °, where b 0 Is the extended Imputation consisting 

only ° of the components whose Indices are In 3^ . This gives k^ 

strict inequalities, so, for £ > 0 sufficiently 0 small, ° 

I I , , 

a °(x^ - (g-l)£) £~b . We can then determine imputations a 1 (Xj_ + g) g-b 1 

for ° 1 / I Q , and 

(a’tX, + £), a 2 (X 2 + £), .... a °(X ± - (g - 1)6), a 0 (3L + . +£),... ) 

o o 

dominates b. (Since £ > 0, X, / - a. , but this is certainly true, since 
i o o 

a (-n t ) » (-1, -1, ..., -1) which does not dominate anything), 
o 

REMARKS 

(1) (n^ ,kj) can be the game (1,1) or more generally (n 1 ,n^). 
Examples of admissible games are (3,2), (5#3), (5,*), (7,*), (7,6). 

(2) In each imputation in V, the players who do not succeed in 
joining a coalition receive -1. In S 1 there are n^-^ such players. 
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Certain amounts X^ are assigned td the sets S i and are divided among 
the players in S ± according to the symmetric solution to the smaller 
games. 

(3) For n large, the decomposition of (n,k) into 
(2n^, Sk^) can he attained in a prodigious number of ways satisfying 
our conditions on (n^k^). The multiplicity of solutions so obtained, and 
the variety of social structures so described seem surprising in these 
symmetric games. 


i 3 . INFLATION OF SOLUTION 

V is called a discriminatory solution to (n+t,k) if there 
exists a partition of indices into two sets S,T with the properties (1), 
( 2 ): 

(1) IT| = t |S| = n 

T US = I, the set of all players . 

(2) For all a G V, a i = c 1 if i £ T, where Ic^ are t 
constants each greater than or equal to -1. Let be the set of 

constant-sum imputations (a S ) in S obtained by projecting V = {a} 
onto S. These have a sum - since 0 - a i = a i + 

2j.es a i = c i + 2ies a r 

LEMMA. V® is a solution to the game strategically 

equivalent to (n,k) where 

V(S,) = - IS,| if IS, I < k 

= n - IS, | - 2 ier c i ^ 13,1 > k . 

S T 

PROOF. Let b be an imputation with projections b ,b on S 
and T and assume b T = c. We show that b S is either in V 3 or domi¬ 
nated via an effective set in S. If b 6 V, the lemma follows. Otherwise 
for some at V, a.^ > b^ for k indices. However c^ « b^ for i t T, 
so the k indices must be in S. Hence a S £-b S , which was to be proved. 

We propose to reverse this process, and study the inflation of a 
solution V n to (n,k) by assigning t additional players fixed amounts. 
By strategic equivalence, we can consider the game for which a i » 0 

so V s -V . The relation: ”k-player sets are certainly necessary, and 
all other sets are certainly unnecessary” is sufficient to define the game 
(n + t,k), for k > is invariant under strategic equivalence, and 
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is the only relation used in our proofs. Let X be chosen so V(X) has 
Xi € g a ± - 0 for a G V(X), and hence Sigt a i “ Let a i * c i for 
i G T (the c^ will differ from their zero-sum analogues in V). Where 
no confusion could arise imputation will be used in one or other of two 
senses: 

(1) An element b G A where A is the (n+t) -dimensional space 
of extended Imputations over S U T. 


bi > -1 

- x • 

(2) A zero-sum imputation over the indices in 3. 


THEOREM. 


solution to 
if k > . 


A sufficient condition that V(X) be a 

(n + t,k) over A is max c* < ■ ■■ ■ - 1 ■ , 

iGT 1 n " 1 


DEFINITION. An imputation b is certainly un¬ 
necessary if we know (owing usually to the domination of 
certain related imputations) that it can be dominated by 
an a G V. Otherwise, b is certainly necessary. 

LEMMA 1 . The imputations b with b i < c^ for 
exactly 1 components L C T are certainly necessary 
if and only if (1) 2^ is a maximum for all |L| =1 

(2) r-1 for i G L 

b H 

c^ for i G T - L , 

for 1=0, 1, ..., t. 


PROOF. It is evident that these are exactly the imputations, 
for fixed 1, for which 2i£S = a maximum. Thus given an imputation 
b* with bj < c^ for exactly 1 components we can find an imputation b 
in the set defined by the lemma, with b ± = bj + i, g > 0 for all i G 3. 
If V(X) ^ a fe-b via the set U, then U U 3 contains at least 
k + t - 1 components a * ^ b^ > bj, and a^ > b^ for 1 components in 
T. Hence a fc-b*, so we need not consider b*. Q.E.D. 

For 1-0, the theorem now follows from the fact that V is a 
solution to (n,k). 

It remains to find a G V n with a^ > for a set of 
indices (1). If L s Is an index set in S with 

(1) |L S I - 1 > 0 


k - 1 
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define b*, an 


(2) SlGL b i is a maxlDn;Bn for all seta U C S with |U| « 1, 


imputation over the Indices S with 
-1 If 1 6 L_ 


b I 


If 1 G S - L s 


If bj < 0, by a previous lemma, there exists a £ V n with a fc-b* 

.'. a^ > bj for k components 

. *. 5i > b i for at least k - 1 components, 

since bj for at most 1 components. Then if a is defined by 


a i - 



for 

for 


i € T 
i £ S 


then a € V(X) and a £-b as required. 

In view of this proposed construction, those luputations for 
which 2 bj is maximized are certainly necessary, and all others are 
certainly unnecessary. Also X bj is maximized if and only if 

b^ = constant for all i £ S, (1 > 0) , 


since b* obtains from b by replacing the largest 1 components in S 
by -1 . 

Number the indices in T(1, 2, ..., t) such that 

C 1 °2 > • * * > c t' Th6n b l = ("' ) + 2i=l + i ^ C 1 " 

(1 + 2iii c i)> 8111(1 for 1 € S, b ± = Jj(l + 2^, c^ . Then 
^1GS b l = (n - l);d + c i) " 1 which is < o by hypothesis. 

Xiii c i < n - 1 (1=1.2, t) . 

But for 1 > 2, this condition follows a fortiori from the relation 
c. > c„ ... > c n and c. < ~r . Hence max c, < U-r ls a sufficient 
condition. 

Thus every solution to (n,k) can be inflated to a solution to 
(n + t,k) by assigning the t additional players constant amounts less 
than throughout. The inverse transformation T -1 (X) maps this 

solution V into a solution to the normalized game. 

The construction of b* was necessarily crude since we know 
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nothing about the solution V n * If V n is the symmetric solution V R k , 
then an imputation a € V n k should be chosen to majorize the smallest 
k - 1 components of b^ in S. In our former notation, an imputation 
a G V n ^ is characterized by the s quantities («*p c* 2 , .oC g ), where 
now we do not insist that < ... < otg. If (q-l)p < k - 1 < qp, 

then for i > q we may set - -1. Let (1 •, 2*, ..., n') 
bp < b 2 , < ... < kfc- 1 * 1. ••• < t> n i £ief ’ ine a numbering of the indices in 
S. If (q-1)p + >j - k - 1 define bvj + (I - 1 )p + £ - c^, 1 < i < q, 
where £ is chosen so *± " 0> 

If a is defined by 


& 1 - a 2 ••• “ a >I = °S 

a (i-2)p+l)+1 = ••* = a (i-l)p+>, “ *S. 2 i 1 i q 

a (q-l)p+>l+l a qp “ *1 

a v - -1 otherwise 


(where for simplicity in notation the primes are suppressed) then a i > b 1 
for i < (q-l)p+ij * k - 1 provided £ > o. 


THEOREM. If V n k is the symmetric solution to 
(n,k) and V(X) is the set of imputations formed by 
assigning t additional players fixed amounts, then 
V(X) is a solution to (n+t,k) provided max c i < 
where 1 


f r if r ^ o 

H 

\p if r « o . 

This condition is necessary and sufficient. 

LEMMA- If the above construction is planned (and 
It is the best possible), then the imputations b 6 A 
for which 

(D 
( 2 ) 
( 3 ) 
(*) 


b i- ^ 


c 1 for i G T - L 
-1 for 1GL 
-1 for I < >J in S 
constant otherwise . 
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are certainly necessary, and all others are certainly 
unnecessary. 

PROOF. ((1), ( 2 ) follow from the proof to the previous theorem 
and (3), (4) obtain by minimizing t) . 2 1GS b ± - 1 + 2)*^ c i as before, 
and the constant value for b^ in all but (t| - i) components of S is 
(1+»1 -1 + 2^ c ± ). Since 2 a ± - o, 

M [ idjTT (1 ♦ l| -1 ♦ 21 °i> + * ] - (n ' Pq) = ° • 

Imposing the condition £ > 0 and simplifying the resulting expression: 

Siii °i< • 1 J - ^ - a p I for 1 = 1 . 2 . •••. t. 

The right hand side Is proportional to 1 If q stays constant, however 
when q decreases by 1 (as 1 increases) the constant of proportionality 
increases. Since c 1 > c 2 > ... > c^, the inequalities above are implied 
by the first one. For 1=1, q = s unless r = 0 in which case 
q = s - 1 . 

Hence 


max c* < 
i 1 


n-r 
l n-p 


if r ^ 0 
otherwise . 


This shows that the condition is sufficient. But the use of certainly 

necessary imputations and optimal constructions implies necessity also 

(which can be independently verified by obtaining a contradiction for 

max c* = —r or ). 

^ 1 n-r n-p 

COROLLARY. Any zero-sum imputation b is in at 
least one solution to (n,k). 


PROOF. Index {b ± ) so b, < b 2 < 

X = n jln-k+1 b l 
^ + ^n-k+1 b l 


. £ b n and define 


It can be verified that b(X) has 2^-k+i b l (x) " °- Sinoe 18 a 

monotone transformation 


max b* (X) 
i < n-k 1 


Vk«> < nkSS-l»l b l (X) 


o . 
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Let « b^X) for i 1 k, and let V be the set of all 

Imputations (a) with a >jL * for i < n - k. Then V is an inflation 

of the symmetric solution k to the game (n,k), with max . 

Since b(X) € V, b is in the*analogue of this solution in * the space of 
zero-sum imputations. 

The inequality obtained for the symmetric solution with k * n 
is max c^ < which agrees with our general theorem. The condition 

of * the general theorem is therefore the best possible (as a function 
of n only). 


i h . LIMITING CASES OP INFLATION 


Suppose C 1 = c 2 = ... c i = where 


f r 


A= J 


P 


if r ^ o 
if r - 0 . 


Then c^ = if 1 < min (1 Q , A) and c i otherwise (1 < t) . 

In fact the summation need only be carried out over a set containing 1 
indices in (1, 2, . , i Q ). Our previous arguments show that the only 
imputations in A undominated are the certainly necessary ones: If L 
Is any set in (1, 2, ..., i Q ) of exactly 1 indices and Lg is any set 
In S of T| - 1 = A - 1 indices, then the Imputation b defined by 


r -1 If i G L U L s 


b 


1 


J Cl If lfT-L 


[rh lf lf3 - L 3 

is undominated by any a € V, for all choices of L,Lg. Let V be the 
union of these imputations for all choices of L,Lg. (Since 
|L| + |L s l*l + A- l“A<k, no Imputation in V can dominate another 
(for the effective set must be L U Lg). Then V + ? is a solution unless 

there are imputations b C f, a G V with b t-a, 

For A - r ft o, ~ °4. “ H^A * 80 ^1 ^ n^A for at least 

one i - i Q . But b^a Is only possible via a k-element set in S, and 
there are p * n - k + 1 elements a v * for which b v > a y . Hence 
V + 7 is a solution if r ^ o. 

If A ■> p, r - 0, the average value of the is 

s 2^.1 «^i - o, so we exclude from V all imputations a* for which all 
are less than . Call this restricted set V*. V - V* is not 
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needed for the domination of an imputation having 1 > 0 since by con¬ 
struction the imputation required for domination could have p components 
equal to -1, hence some p components are greater than or equal to 
, as required. For 1*0, the arbitrary imputation has either 
n - k + 1 * p indices in S not less than which case it is 

dominated by an imputation in V - V*, or has not more than n - k ele¬ 
ments not less than > *n which case it is dominated by an imputation 

in V. We have proved: 

Theorem. If c 1 * c 2 « c i * , and V is the inflated 

solution to (n + t,k), let V be 0 the set of all imputations having 1 
components in (1, 2, ..., i Q ) equal to -1, A - 1 components in S 
equal to -1, (1*1, 2, ..., mln(A,i 0 ) the other components in T equal 

to c^, and the other components in 3 equal to . Let V* be the 

set of imputations in V with a i = for all i G S (V* is empty 

unless r = o). Then V + V - V* is a solution to (n + t,k). 

The discrete solution (a finite number of imputations) to the 
3-person game (or more generally to the game (n, , which is zero sum) 

can be obtained by inflating V 2 2 (or V n+1 n+1 )> to the limit. 

“T" ,- 2~ 

CONCLUSIONS AND CONJECTURES 

(1) Inflation, and inflation to the limit, are very important 
methods for obtaining new solutions once a discriminatory solution is known. 
In the latter case, it often happens that much of the original solution is 
omitted, at the cost of adding a finite number of imputations, and this is 
very useful in finding finite solutions themselves. 

(2) By carrying out the inflation relative to this particular 
strategically equivalent game, it is evident that the limiting solutions do 
not depend on possibly carrying out the inflation one component at a time — 
all possibilities are subsumed in this general theorem. 

(3) The games (2n+l, n+l) are the only zero-sum games in this 
class (they are the simple majority games), and it is evident that the 
natural way of determining their solutions is by means of the family l(m,k)) 
of associated non-zero sum games. Finite solutions have been found only 
for zero-sum games, and the larger the ratio ~ becomes, the higher is the 
dimensionality of the solution. 

(4) The natural way of considering all solutions found so far 
is in terms of symmetric solutions. 

(5) Non-discriminatory bargaining solutions probably do not occur 
for games with r ^ 0. (This is true in the zero-sum case, but remains to 
be shown otherwise). 
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QUOTA SOLUTIONS OP n-PERSON GAMES 1 
L. S. Sliapley 

i 1. SUMMARY 

Complete sets of solutions for all three-person games have been 
given by von Neumann and Morgens tern. 2 * 4 For higher games the known results 
are scattered, with no solutions at all for large classes of games and 
complete sets of solutions for only a few special types. 5 Even the exist¬ 
ence of solutions in all cases has not yet been established. 

In this note we present a family of solutions for a class of 
n-person games which embraces all constant-sum four-person games and a not 
inconsiderable array of higher games.^ We call them "quota games" because 
it is possible in them to define a system of individual quotas for the 
players which determines the effectiveness of the various two-player 
coalitions. In our solutions most of the players receive their quotas, 
but there is some latitude for bargaining. 5 The solutions are typically 
one-dimensional sets, consisting sometimes of n line segments joined at 
the quota point, sometimes of n-1 disconnected segments. Their behavior 
under variation of the characteristic function of the game is continuous. 

In the final two sections we present some related, more compli¬ 
cated solutions to games in Q, and describe an extension of the earlier 
results to a wider class of games. 

i 2. PRELIMINARIES 

We shall employ the symbols G, C^, A , U , - , in the customary 


^he preparation of this paper was sponsored in part by the RAND Corpora¬ 
tion and the Office of Naval Research. 

2 J. von Neumann and 0. Morgenstern, "Theory of Games and Economic Behavior," 
Princeton, 1947 ("TGEB" in the sequel): sections 32 and 60-3- 

5 See e.g., TGEB: 36 . 1 . 1 , 54.2.1, 60.4.2; also other papers in this volume. 

4 See the tables on pages 347 and 359 below. 

^Details are given in the heuristic accounts which accompany Theorems 3# 

4, and 5* 
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way; we shall us© (1, j, ..., m) for th© set consisting of th© distinct 
elements I, j, ..., m, without regard for order, and |S| for the number 
of distinct elements in the (finite) set S. Greek letters without sub¬ 
scripts will represent n-vectorsj will stand for the vector whose 

i-th component is 1, all others o. By [«t,0] we shall mean (until 
section 6) the set of vectors of the form 


(D 


tel + (1 - t)0 , 0<t<1 


— geometrically, the straight segment joining cL and 
Let I denote the set of players; |I| - n. 
n -person game v is a function from the subsets of I 
satisfying 


0 - 

A general-sum 
to the reals 


( 2 ) 


v(0) - 0 , 


(3) v(S n T) + v(S - T) < v(S) , (all S, TCI). 

It is constant-sum if there is equality in (3) for S = Is 

(4) v(T) + v(I - T) - v(I) (all TCI). 


If equality always holds In (3) for some particular T, then the game is 
said to be decomposable into the games on the sets of players T and 
I - T; if such a T consists of a single player, he is called a dummy . 

If all players are dummies, then the game is inessential , and Its theory Is 
trivial. 


We shall sometimes write v^, v 1 j, etc., for v((i)), v((i,j}), 

etc. 

The space A of "imputations" is defined as the set of oL which 

satisfy 


(5) 


^iCI *1 “ v(I) 


(6) «•*! > (all 16 1) 


— geometrically, an (n-i)-dimensional simplex. If 


(7) * ± > V (all 16 3), 

(8) £ 16S \ < v(S) 

both hold, we say that 0 S- dominates d, and write d. € 3-dom 0. It is 
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easily verified that S-domlnatlon can occur between two Imputations only If 

(9) 1 < IS| < |I| . 

We now define the dominion of a single vector: 

( 10 ) dom a. = U sa S-dom dL , 
and of a set of vectors: 

(11) dom V = dom ck. 

Finally, V is a solution (of the game v) if and only if 

( 12 ) V = A - dom V . 

i 3. QUOTA GAMES 

By a quota in a game v we shall mean a vector u) having the 
two properties: 

( 13 ) (all 1 ^ j) , 

( 1 ^) X 16 i w i = v(I). 

From (13) we see at once that, for |I| > 2 , the quota, if it exists at 
all, is unique. Let q. denote the class of games which possess quotas, 
the "quota games." 

THEOREM 1 . The n-person game v is in G(. if and 
only if 

( 15 ) v ±j + v kl = Vlk + Vj X (i, j, k, 1 distinct) 

always holds, and 

( 16 ) Sijei “ 2 (n - Dv(I) . 

i/J 

PROOF. ( 13 ) and (14) directly yield (15) and ( 16 ). Conversely, 
given v satisfying ( 15 ) and ( 16 ) and n > 3 (the theorem is trivial for 
n » i, 2 ), the expression 
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(17) “j. - ^.(v^ + v ik • v jk) (1» j» * distinct) 

is Independent of j and k, and can be used to define a vector «>. (13) 

now follows from (17)• To obtain (i*), sum (17) over all distinct (ordered) 
triples (i, j, k), thus: 

(18) (n - D(n - 2) 2 16I «i - | (n - a) S 1J6I v ±j 

(the last two sums cancel). An application of (1 6 ) now gives the result. 
COROLLARY 1. If n Is even, (15) follows from 

(16). 

PROOF. Let IT he a partition of I into two-element subsets. 
Then, by (5) a 

( 19 ) ^scir v(s) 1 v(I) • 

Averaging (19) over all such partitions we obtain, since each S will 
occur the same number of times: 

(2°) jjrr ^sci v(3) 1 v(I) • 

|SI=2 

By ( 16 ) we have equality here, and hence also in ( 19 ) for every IT. ( 15 ) 
now follows easily. 

COROLLARY 2. If n is even, then v £ if and 
only If 


( 21 ) v(S n T) + v(S - T) - v(S) 

holds whenever |S|, |S n T|, |S - T| are even. Thus, 
in even-person quota games, 

( 22 ) X i6 s “i " v(S) (all 3 £• I ' I SI even > • 

PROOF. Assume v £ q. By (3), (13), 0*0* we have 

(23) v(S ft T) + v(S - T) + v(l - S) > S 16SftT ^ + 2 i6 s_T “j. + S 161 . 3 

- v(I) 
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> v(S) + v(I - S) , 

if all the sets in question have even numbers of elements. Then (21) 
follows from ( 23 ) and (3)* Conversely, ( 21 ) implies ( 15 ), permitting us 
to define <*> by (17) (except in the case n « 2 , for which the corollary 
is trivial). This vector has the quota properties ( 13 ) and (14), as 
required. 


COROLLARY 3* All inessential games, and all con¬ 
stant-sum four-person games, are in 

PROOF. For inessential games, put ^ = v^, all 1 G L For 
constant-sum four-person games, apply Corollary 2, using (2) and (4). 

An Idea of the extent of the class Q may be gained by repre¬ 
senting each n-person game v as a point in the cartesian space of 2 n 
dimensions and then comparing the dimension of the (convex) set of quota 
games with the dimension of the (convex) set of all games. In such repre¬ 
sentations It is customary to consider just games in "reduced form" and to 
disregard inessential games. 6 This has the effect of making the convex 
sets bounded, and of reducing their dimensionality by n + 1, without 
substantial loss of generality. The comparison follows, calculations 
omitted. 


n 

All games 

general-sum constant-sum 

Quota games 

general-sum constant-sum 

2 

0 

(none) 

0 

(none) 

3 

3 

0 

2 

(none) 

k 

10 

3 

7 

3 

5 

25 

10 

19 

k 

6 

56 

25 

31 

15 

(even) 

(odd) 

2 n -n -2 

2 n_ 1 -n-i 

2 n_1 -1 

2 n -(£)-3 

2 n_2 -1 

2 n - 1 -(jJ)-2 


A quota is not necessarily an imputation: condition ( 5 ) is 
assured, but not (6). Define the quantities c^: 


^Compare TGEB 39. Use of the reduced form in the body of this paper would 
tend to obscure relations and results, without producing any substantial 
simplification. 
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(2*0 c i ” W i “ V 1 (i 6 15 

— they are effectively the barycentric coordinates of ^ in the simplex 
A. A player o for whom c Q is negative is called weak . A dummy in an 
essential quota game, for example, is weak. (Indeed, we then have, for 
each i / o, 

(25) °o - w o - (v oi - v i ) “ - W i + v i - -°1 ' 
whence 

( 26 ) c o “ ‘ n ^2 ^161 °1 • 

n 

This quantity is negative in an essential game.) 

THEOREM 2. In a quota game there is at most one 
weak player; if |I| Is odd, there Is none. 

PROOF. By (3) and ( 13 ) we have, for any i ^ j, 

(27) + V. < v ±j - + Wj • 

Therefore i and j cannot both be weak. Furthermore, if |I| is odd, 
we have for any i: 

( 28 ) v(I) - v ± > v(I - (D) > % K1 <Oj = v(I) - , 

by applying successively (3), (13) and (3), and (14). Therefore i alone 
cannot be weak. 

4 k. QUOTA SOLUTIONS 

We shall now proceed to construct solutions to games in ^ out 
of the quotas, <*>, (when in A) and certain closely related imputations. 
We define the vectors: 

(29) 

(30) 

7 We return to .this game in section 5; it is the only instance of a decom¬ 
posable quota game. 


» u> - Cj4* + c^y^ ; 

- u>- c^y 1 - c k / + (c^ + c k )«r* • 
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In referring to these vectors, we shall sometimes speak of j as the 
"beneficiary" of i. 


LEMMA. If there Is no weak player, or if i is 
weak and j ^ i, then is in A. If k is weak 

and i, j ^ k, then is in A. 

PROOF. Immediate, from the definitions. 

THEOREM 3 • If <*> Is in A, and if ^ i is 
an otherwise arbitrary function from I into itself, 
then 


I I 

(3D V b =U iGI [U> '* ] 

is a solution of the quota game v. 

GEOMETRICAL DESCRIPTION. consists of n segments parallel 

to edges of A radiating from one to each (n-2)-dimensional face. 

If u) Is In the boundary, then one or more of the segments is degenerate; 
but all are degenerate only if A is degenerate as well — i.e., If the 
game is inessential. When n is even, it is possible to have b^ = i, 
all i, whereupon the segments are colinear In pairs, and 1 consists 

of n/2 segments meeting perpendicularly at w. 

VERBAL DESCRIPTION. The standard of behavior attributes to each 
player a quota and a beneficiary; a player may be the beneficiary of 
several, or none, of his opponents. In a particular play of the game 
either all players take their quotas, or one player accepts less and gives 
the difference to his beneficiary. However, no player ever receives less 
than the minimum which he can guarantee himself unilaterally — thus, a 
player whose quota and minimum are equal will never assume the role of 
benefactor. When the number of players Is even, one solution (mentioned in 
the preceding paragraph) has them pair off, as if to bargain over the 
division. In a particular play, any one pair may divide their combined 
quotas in an arbitrary way, compatible with their minima, while the others 
settle for their individual quotas exactly. 


PROOF OP THEOREM 3. (I) To show A - dora C V^. The <L in 

A fall into three categories: 


1 

r (i) 

*i< u i 

(some 

d, ^ 

< 

u j 

(some 

3 / i); 


(32) •< 

; (id 

*i < w i 

(some 

i) » oU- 
i) • J 

> 

“j 

(all 

3 / i); 


1 

L (in) 


(all 




* 
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In the first ease ve have d, £ (i, j)-dom w. In the second case ve have 


(53) *1 + i w i + u b 1 • 

Ve can therefore choose t to satisfy one of 


(3%) 


{ 


The vector p: 
(35) 


< lia) 

( ±ib) X “ \ < * < W 1 - *1 • 

P - a) - ttf 1 + ttf 1 , 


Is In V^, and ve have either d> * P or cL £ {I, b^J-dom f>. In the third 
case ve have at once «L - u>. Hence every Imputation Is In either V b or 
dom V^. (II) To shov C A - dom V^. By the lemma, C A. A simple 
check of the conditions (7), (8), (9) for domination reveals that the 
assumptions £ V^, 0 £ and dL £ dom 0 are inconsistent. Hence no 
imputation is in both V b and dom V b . 


THEOREM fc. If (*> is not in A, let o denote 
the veak player. Then 


U 


i£I 

i/o 


It 


ol 


iob, 

V i ] 


is a solution of the quota game v, vith b as in 
Theorem 3* 


GEOMETRICAL DESCRIPTION. consists of n-1 unconnected seg¬ 

ments parallel to edges of A, issuing from points in the face A Q defined 
by 

(37) d o “ v o * 0 ' 

and running one to each of the other (n-2)-dimensional faces. Some or all 
of the segments may lie vlthln A Q , and some or all may degenerate to points 
in the boundary of A q j but all degenerate if and only if o is a dummy. 8 


8 Ste (4ij belov. 



QUOTA SOLUTIONS OF n-PERSON GAMES 


351 


VERBAL DESCRIPTION. The standard of behavior assigns quotas and 
beneficiaries as before, but the weak player's quota is belov his minimum. 
In a particular play there is always one benefactor; he may be anyone but 
the weak player. He first makes up the weak player's deficit out of his 
own quota, and then, perhaps, gives an additional amount to his assigned 
beneficiary — who may also be the weak player. The remaining players take 
exactly their quotas. 

PROOF OF THEOREM 4. (I) To show A - dom V b C V b - Divide the 
d. in A into the categories of ( 32 ). In case (i) we must have o ^ i, j. 
Let k be distinct from o, i, and j (possible by Theorem 2i); then 
eL £ (i, j)-dom y ok . In case (li) we must have o ^ 1 and 

(38) ^i < w i + c o ‘ 

We can then find. In the manner of the preceding proof, an imputation 0 
iob. 

In [V , ] such that either dk. - 0 or eL £ {1, b^-dom 0. 

Case (ill) is vacuous, since u> $ A. Hence every imputation Is in either 
V b or dom V b . (II) To show V b C A - dom V b - Proceed as In the proof 
of Theorem 3* 

i 5 . DISCUSSION. THE FOUR-PERSON CONSTANT-SUM CASE 

Because of the arbitrariness In the choice of the beneficiary 
function b. Theorem 3 gives (n-l) n solutions to each n-person quota 
game with to in A. These are all distinct if and only if to is interior 
to A. If the game v is varied the quota u>, and hence each 
changes continuously. Therefore the solution V b is a continuous function 
of v. 

If v is varied so that c^ vanishes for one or more i £ I, 
putting in the boundary of A, then those solutions whose beneficiary 
functions agree except for such 1 will become indistinguishable, since 
the segments [u>, will have contracted to the single point fa>. With 

b) at a vertex of A there are only n-l distinct solutions (consisting 
of single edges of A). With co in an open (n-2)-dimensional face of A 
the number is (n-l) 11 " 1 . 

For <*) outside A we turn to Theorem 4 and find, in general, 
(n-l) 11 " 1 solutions, again depending continuously on v. If v is varied 
so that c 0 tends to 0 from below, then to approaches the boundary of 
A from the outside, and the points * o1 and a 10 ** approach a> and y 1 ^, 
respectively, so that each V b of Theorem 4 goes in the limit Into the 
corresponding V b of Theorem 3. The transition from one case to the other 
is perfectly continuous. ^ 
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If v la now chosen to make , 

(39) c ± - - c Q > 0 

for one or more I G I - (o}, then the number of distinct solutions 
provided by Theorem 4 is reduced as a result of the segments 
[f oi , contracting to the isolated points tf oi . The quota games in 

which (39) holds for all i ^ o are noteworthy, since they alone have 
finite quota solutions. It can be shown that, for such a game. 


(««5) 

v <s) - 2, i6S 

V ± - (|S| - i)c Q 


(for 

|S| odd) , 


m ^ies 

0 

0 

CM 

in 

1 

•H 

> 

(for 

I3| 

even, 0 G S) , 


" ^16S 

y ± - (|S|)c 0 

(for 

|S| 

even, 0 $ S) . 


The game is constant-sum^ and symmetric in the essential players, o is 
a dummy, and, of course, |I| is even. The unique quota solution, by 
Theorem 4, consists of the n-1 separate points: 

(M) P 1 = V - X j6I c 0 <fj (all l^o) 

where V denotes the vector £jV k <f k . 

In the four-person case, visualization of the foregoing dis¬ 
cussion is aided by a remarkable one-one correspondence that exists between 
the range of <*> (the imputation space A and its environs), and the 
parameter space of games v. von Neumann regards the essential four- 
person constant-sum games in reduced form as the points of a certain cube 
Q. 10 (See Figure 1.) 


^Indeed, It Is an open question whether finite solutions exist except for 
constant-sum games. 

1 °TGEB 34.2. Figure 1 has been drawn to conform to Figures 61-63 
loc. cit. 


'■'tea 
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VII III 



Figure 1. Partition of Q into the 
tetrahedra T, T 1 , T 2 , T^, T^. 


Four of the vertices of Q (o in the figure) are the games with dummies; 
the other four (•), spanning the inscribed tetrahedron T, are the games 
in which one player is so strong that only a coalition of all his opponents 
can defeat him. The four other tetrahedra T i# named after the dummies in 
their vertex games (o), form the complement of T in Q. 

Now it is possible by a linear transformation mapping the imputa¬ 
tion space into the game space to superimpose A on T in such a way that 
co coincides with v for every game v. The range of <*> is then exactly 
Q. Theorem 3 (no weak players) applies to games in T, while Theorem ^ 

(i weak) applies to games in T ± . T comprises one-third of the volume of 
Q; each T.^, one-sixth. The relation of the weak-player games to the 
whole set is well illustrated by this representation. 

f 6. FURTHER SOLUTIONS INVOLVING THE QUOTA 
A study of the three-person quota games, whose theory is com- 
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pletely known, 11 reveals that the quota w belongs to every solution, and 
that the solutions provided by Theorem 3 are special cases of a continuous 
family of solutions, consisting generally of arbitrary monotonic curves 
connecting to each edge of the triangle A. (See Figure 8.) 


1 



Figure 2. Typical solution of a three-person quota game. 

Similar continuous families involving <o exist for higher quota 

games, but do not in general include all solutions. Their precise nature 

depends upon detailed properties of the function v, and there are many 

cases to be distinguished. We shall prove here a result which generalizes 

the three-person solutions just described to a limited class of higher 

games, and then give without proof a more complicated example. 

First let us revise our definition of hereafter it will 

denote an arbitrary curve connecting the points and p along which all 

the coordinates, and their sum, vary continuously and monotonically (but not 

necessarily linearly). In our usage up to this point cc and f& have never 

differed in more than two coordinates, therefore the revised definition 

1 2 

could have been employed from the start. 


^TGEB 6o. 3«3* with a 1 + a g + a^ - 0. 

Hunder the old definition the theorems of this section are still correct, 
but less general. 
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THEOREM 5» If 1 b^ ^ i and b^ / i ape otherwise 
arbitrary functions from I into itself; if the vector 
T satisfies 

(^2) ° < r i < 1 (all i G I) ; 

and if, finally, the inequality 

(*3) + w b _, + ^ > v((b ± , b|, j)) 

holds whenever i, b^, bj[, and j are distinct and 
c^ and Cj are positive; then 

I I ib i ib, i 

<uo v bb , =U 1GI [u>, (1 . x ± )r 1 + t ± Y 1 ] 

solves the quota game v if u) is in A, and 

lob. iob] 

161 l * ’ ' T i>* 1 + V 1 

i^O 

solves it If u) is not in A, o being the weak player. 

For b = b', this reduces to Theorems 3 and For |I| » 3, 

(43) is no restriction, and we obtain the results alluded to at the 
beginning of this section. For four-person games with a weak player o, 
the theorem yields new solutions If one takes b and b' so that for each 
i, b£ « o If and only if =* o. But the theorem is unproductive for 
constant-sum games with u> interior to A unless the number of players 
exceeds five. 

VERBAL DESCRIPTION OF THEOREM 5- A player may have two 
beneficiaries, provided that it is not possible for them to form an effec¬ 
tive three-person coalition with some other benefactor. The rule by which 
the benefits are split is arbitrary (but fixed under the standard of 
behavior), except that neither beneficiary’s share decreases as the other's 
Increases. 


PROOF OF THEOREM 5. Suppose that u) is In A, and define for 
convenience: 


(I) To show A - dom V bb , C V bbl . Divide the «L in A into the three 
categories of (32). In case (i) we have £ (I, j)-dom u>. In case (ii) 
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there is a unique p € V 1 with by the mono tonicity of V 1 . 

Either 


(47) 


(iia) cL - P , or 


(iib) cl k < P k for k = b ± or 


In case (iia) we have el Q V 1 . In case (iib) we can find, using mono¬ 
tonicity and the fact that P ^ to, points in V 1 near p which 
li, k)-dominate d. In case (iii) we have d = <*). Hence every imputation 
is in either \b- or dom v bb- (II) To show v bb- £ A - dom v bb- 
Proceed as in the proof of Theorem 3, observing that the hypothesis (43) 
exactly excludes the possibility of S-domination for |S| = 3* This 
establishes (44). The proof of (45) Is similar- 

Theorem 5 provides a family of solutions connecting V-^ and V-^,, 
assuming condition (43) Is fulfilled. The next theorem Illustrates one of 
the more elaborate "connections" that are found in some cases in which 
(43) does not hold. The solutions "connected" are V b (at e = 0) and 
, (at e = 1), where 


r 


(48) 



b ± = k , bj_ = 1 

b J = l ' = k ' 

= m , b£ = m , 

b-^ = n , b£ = n . 


(all 1 ft j, k, 1) , 


(49) 


THEOREM 6. If u) Is In A, and If 
+ % + W 1 < v jkl ' 


for some distinct j, k, 1; then, for arbitrary m / k 
and n / 1, the set 

(50) [03, (i - ejr^ 1 + ey Jk ] u [w,^] 0 [u>,ir ln ] 

Mirt.k.i t(1 - ao j/° 1 )» + (ec j /c 1 )r llc ,ar lic ] 

c l>eCj 


V 
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is a solution of v for 0 < e < 1/2 (Figure 3ab); 
the set 

(51) [w, (1 - e )*^ 1 + ejf^ k ] u [w,^] u 

u U ^] (k>1 [(1 - (1 - e)Cj/c i )o>+ ((1 - e)c J ./c 1 )jr L 1 ,y il ] 

c ± >( 1 -e)cj 

is a solution for 1/2 < e < 1 (Figure 3de); and, if 
we also have 

( 52 ) c. > c ± (all i / j, k, 1) , 


then the set 

(53) [<*>, 0 - e)^ 1 + ey J ’ k ] u £u>,y 1 ™ 3 ] u [u>,y ln ] 

0 1(1 - eo / c l )w + ( ec jAi)y lk ) 

c l > c / 2 

U 4^j,k,l ((1 - ec / c i)“ + (ecj/c^r 11 ) 
c l > c / 2 

is a solution for e = 1/2 (Figure 3 c). 


Among the noteworthy features of these solutions are the follow¬ 
ing: (a) Some of the segments in ( 50 ) ana ( 51 ) are detached from oi; 
thus there is a positive lower bound, (equal to ecj in ( 50 )) for some of 
the benefits, (b) Some of the segments disappear entirely; thus I is 
not a benefactor in ( 50 ) if 0 < c i < ecj, i ^ k, 1, yet he always gets 
more than his minimum, (c) Isolated points occur in the central case (53) 
whenever Cj/2 < c 1 < c^ for some i ^ k, 1; these can lie in the interior 
of A. 

As Figure 3 reveals, the family of solutions is not continuous 
in the usual sense. 15 Its "connectivity” is similar to the ”connectivity" 
of the set of all solutions to a constant-sum three-person game, a property 
which has not yet been given an adequate characterization. 


15 If it happens that c, < c */2 for all i ^ j, k, 1, then the family of 
Theorem 6 is lower semi J continuous. 











Figure 3. Two-dimensional sections of A through 
«a # illustrating the connection between and V^, 
obtained in Theorem 6 by varying e. (The letter "i" 
stands for a typical member of I - (j, k, 1).) 
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4 7- EXTENSION OP RESULTS 

By known methods one can readily: 

(a) solve a class of strategically equivalent games, given a 
solution to one of them; 

(b) obtain a solution to a decomposable game, given a solution 
to every component; 

(c) obtain a solution to each component, given a decomposable 
solution to a decomposable game; 

(d) given a solution to an n-person game, obtain a solution 
to its (n+1)-person zero-sum extension; 

(e) given a solution to an n-person game lying within a face of 
A (a "completely discriminatory" solution), obtain a solution to the 
(n-l)-person game formed by removing the player in question. 1 ^ 

Let <Q> denote the set of ordered pairs <v,V>, where v is 
in and V is a solution of v given by Theorems 3-6. Let <Q>* be 
the smallest set containing <Q> and closed under the extension operations 
indicated in (a) - (e) above. The set Q* of games occuring in <Q>* then 
represents a class of games solvable directly or indirectly by the results 
of this paper.^ The dimensions of the sets of essential n-person games 
in reduced form in Q* are as follows, for small values of n: 


Games in Q* 


n 

General-sum 

Constant-sum 

2 

0 

(none) 

3 

3 

0 

4 

7 

3 

5 

19 

7 

6 

31 

19 


(Compare the table on page 347 above.) The present sets are not convex. 
Hence, although substantial improvement over Q. is apparent in for example 
the five-person constant-sum case, the dimension numbers do not fully 
Indicate the effectiveness of the extension. 


^TGEB 57-5, 44.3, 6o.4. Although not mentioned in TGEB, (e) Is easily 
verified from the definitions. 

15 This process of extension can of course be applied to any class <£> of 
games with solutions (compare TGEB 54.2.1) . In the present case it turns 
out that (d) and (e) are most powerful, while (b) contributes nothing. 

L. 3. Sh&pley 


Princeton University and 
The RAND Corporation 




ARBITRATION SCHEMES FOR GENERALIZED 
TWO-PERSON GAMES 1 

Howard Raiffa 

1 .1. INTRODUCTION. Jolm von Neumann and Oscar I. Morgenstern 

P 

in [9] analyze the discrete zero-sura two-person game and indicate that to 
each such game there exists a unique value. The solution of this type of 
game has a strong stability in the sense that if both players are made 
aware of a saddle point (in the generalized space of mixed strategies), 
there is no tendency for either player to act out of conformity with the 
predicted mathematical solution. However, in the two-person non-zero-sum 
game, no attempt is made in [9] to establish the solution as a unique 
element, but the solution is uefined as a family of imputations which is 
characterized by a set of requirements. It is felt that this multiplicity 
of solutions is In harmony with realizations of this mathematical model 
(e.g., the duopoly or the duposony behavior in economics). The actual 
solution in a given real life situation depends on the psychological be¬ 
havior of the players in this bargaining problem. In essence, we are faced 
with the problem of the two players choosing a "best” element from a set of 
inconparable elements. The Inability of the contestants to arrive at a 
mutually satisfactory return in this bargaining situation often results 
empirically In the playing of the non-cooperative game. The imputation 
thus attained is not. In general, an element of the solution set and there¬ 
fore is dominated by some imputations of the solution set. In situations 
of this type it behooves the players to offer their case for arbitration. 

To be objective, the arbiter must seek an imputation from the solution set 
which satisfies a set of so-called "fair" requirements which is dictated by 
the sociological, economic or political environment in which the game is 
embedded. Motivated by the role of arbitration in collective bargaining 
disputes, we define a scheme of arbitration as a mapping from a given 


The preparation of a more complete version of this work was sponsored by 
the Office of Naval Research. See item [10] In the bibliography at the 
end of this paper. 

o 

The numbers in square brackets refer to the bibliography at the end of m - 
this paper. 
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generalized two-person game into a unique element of the solution set of 
that particular game. We shall initially require that the domain of the 
arbitration mapping shall at least include all two-person games with a 
finite number of pure strategies. Various conditions are imposed on the 
arbitration schemes, and this paper shall attempt to construct mappings 
satisfying these desiderata. No attempt will be made on the formal level 
to single out a "best" method of arbitration; however, certain provocative 
games will be arbitrated according to different conventions to aid in the 
subjective evaluations of these conventions. The results and motivations 
for this paper were obtained independently of the work of J. P. Nash, Jr., 
on the two-person non-zero-sum game. 

1 . 2 . UTILITY MEASUREMENT. We will follow von Neumann and Morgen- 
stern in hypothesizing a numerical utility determined up to the group of 
positive linear transformations. However, in this paper two distinct cases 
will be considered.: the existence or non-existence of a common unit of 
measurement. In the former case we will require that the theory be in¬ 
variant only up to utility transformations on the players' payoff entries 
that do not destroy the interpersonal comparison of the unit of measure¬ 
ment. In the latter case we require invariance up to independent utility 
transformations. Further, in the case where a common unit is hypothesized 
we will distinguish between the cases where side payments are or are not 
permitted. For example, the entries may be in monetary units but physical 
barriers might require that no exchange take place between the Individuals. 
In order not to prejudge the problem, the models introduced will incorporate 
all such possibilities.^ 

2 . 1 . MIXED STRATEGY SPACES. 

DEFINITION 1 . Let 0. - {*} [» - [/$)] be the set 
of pure strategies of player I [II]. If the set at jB] 

Is finite, denote the pure strategies by , «l 2 , ..., 

*Sn ^i» •••» ^n 5 * 

DEFINITION 2 . Let A(oi,) 8 ) [B(cL,£)] denote the 
return to player I [II] corresponding to a pair of pure 
strategies («c, 0 ). in the finite case we abbreviate 
] by a^j [bij] • 


5 Bven In the case of a monetary unit It la not quite realistic to assume a 
common unit of measurement. However, it la felt that If one abstracts 
entirely from the Interpersonal comparison of the monetary unit then one 
alters the basic bargaining structure of the game* 
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DEFINITION 3. Let 

R 0 5 (<A(cL,jS), B(*,p)):(dL,/3) € AxJB) • 

That is, R Q ia the range of the mapping, 

A x B s Cl x 18 —> E^ where representa Euclid¬ 

ean 2-8pace. 

DEFINITION 4. Let F 1 [F 2 ] be a Borel field of 
aubaeta of CL [tB] containing all pure strategies. 

DEFINITION 5. Let Sj - ($} [S i;r = (>})] be the 
set of all probability measures over a [fi]. Thus each 
£ [>}] is defined on F 1 [F 2 ] to the Interval [0,1], 
and ^ [^l Is a completely additive measure function. 

In the finite case we let £(4.^) 5 ^ [t}(/3j) s . 

DEFINITION 6. Corresponding to the pair ($,>}) 
associate a vector (A(£,>|), B(§,>J)) where A(£,>}) = 

Jj^ A(d,£)d£ dj 111 the discrete case) 

B(£,>f) = £ B(a,p)d$ d*} ( * Sij bijii^j ^ the dis¬ 
crete case). 

The expressions AC^**]) and B(£,>[) represent the expected 
returns to players I and II respectively corresponding to the pair (|,*J). 
We explicitly assume: A(<JL,p), B(*,/S) are finite and aummable with respect 
to all (|,*|) £ Sj x Sjj and the double integrals are equal to the 
iterated Integrals. Without worrying about the logical niceties we will 
equate the pure strategy oL [/3] with the mixed strategy £ [jj] such that 
|(dL) « 1 [>|(p) - 1]. In this sense a C Sj and C Sjj- We take the 
further liberty of confusing the expressions A(|,rj), A(<*,;8), A(g,/i) etc, 
since the domain of the function will be clear by the symbols used for the 
arguments. 


DEFINITION 7 - Let 

R, - <(A(|,*|), B($,T|)):(t,>j) GSjX S n ) . 

That is, R 1 is the range of the mapping, 

A x B: 3 X x S n —> E (2) . 

In the finite case Sj and Sjj are closed simplexes in E^ 10 " 1 ^ 
(Euclidean m-1-space) and E^ 11 " 1 ^ respectively; thus these spaces m 
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are convex, connected and compact. 

In the finite case we can write the game ^ as a matrix of the 
form IK&ij* t>ij) 11 - For example, the game 


A 




(2, 1) 

(-1, -4) 

1 s 

•s 

(-4, -1) 

0, 2) 


has a region. 



It should be noted that in general the region R 1 of a game is not neces¬ 
sarily convex. It Is possible for the players to convexify the region If 
they use correlated mixed strategies. 

2.2. JOINT STRATEGY SPACE. 


DEFINITION 6-a. 

Let 

j 1 = (?) 

be 

the set of 

all 

probability measures 

over 

F, x F 2 - 

In 

the finite 

case. 

let - 5 xj . 

Thus 

«lj> 0 

for 

all i, i 

and 


2 -0 -o -o — 

= 1 . The space J' will be restricted to a 
subspace J In Definition 8-b (which follows Defini¬ 
tion 9-b) . 


Elements £ and rj will be called mixed strategies and elements 
£ will be called joint mixed strategies. To every pair (4^) we can 
associate a joint mixed strategy which is the product measure (i.e., 

4 x « 5 where 5 i j * 4^) i and *1* ls ln this sense that we 

will consider Sl *S n CJ'. 
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DEFINITION 9-a. If A(d-,|3 ), are summable 

with respect to any J 1 , then for any ? 6 J' let 

(A(S), B(S)) - J ax< (A(et,/8), B(A,jS))d« ( = 2ij (a^.b^ij 

in the discrete case). Now define 


R g - C(A«), B(O) : $ £ J') ; 

that is, R£ is the closure of the range of the map- 

ping, A x B : J' —> E (2) . 

Using the product measure, the product space Sj x S^-j C J* . 
Further, R 1 C R£. In the finite case we note that R£ is the minimal 
convex set containing R Q ; and the boundary of R£ is composed of one- 
simplexes whose vertices are elements of R q . 

DEFINITION 9-b. Let R 2 be the minimal closed 

convex set containing R Q (i.e., the convex hull of 

V- 

Since in the infinite case it Is always possible to define R . 

( 2 ) 0 

this definition Is non-vacuous and unique by noting that E v ' is closed 
and convex and contains R Q , and also that the intersection of closed 
convex sets Is closed and convex. Thus for all games we can associate a 
region R g . 

We can give an equivalent characterization of R 2 as follows: 
let U be the point set which is the union of all line segments joining 

any two elements of R Q . Let V be the point set which Is the union of 

all line segments joining any two elements of U. We will now show that V 

is convex. To this ena, let v 1 and v 2 belong to V, and for 

o < < 1 we wish to show oLv 1 + (i - <i)v 2 £ V. Let u 1 , u 2 , u^, u^ be 

elements of U used in defining v 1 and v 2 , and let e,, e g , ... eg be 
the elements of R Q used in defining , u 2 , u^, u^. It is easily seen 
that clv 1 + (1 - oL)v g lies in the minimal convex set containing e 1 , 
e 2 , ..., eg. Thus cLVj + (1 - ol)v 2 lj.es on a line segment joing two 
boundary points of this minimal convex set. Hence we conclude that V is 
convex. Since the closure of a convex set is convex, we finally have 



We now assert that if R£ is well defined that R£ R g . From 
the above characterization of V, It is seen that V is contained In the 
image of J* under the mapping A x B. Taking closures, we get R g C R£. 
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That R£ C R 2 follows from the observation that the image of J' is con¬ 
tained in R g . Again taking closures, we get R£ C Rg and consequently 

R 2 " R 2‘ 

Since Rg is always defined we will have no recourse in the 
sequel to use the notation R£. If the set R Q is compact we will now 
show that the minimal convex set containing R Q (in the above notation 
this is the set V) is also compact. Since R Q is bounded the set V is 
also bounded. It remains to show that V is closed. Let (v n ) be a 
sequence of elements of V which have v for a sequential limit point. 

To show v £ V. For each n, we have 


A n1 e n1 + A n2 e n2 + 


A n3 e nj + A n4 e n4 


where 2^ ® 1 > A nl > o, e Ri G R Q . By a diagonalization process there 

is a subsequence (V ) such that ± e ^ —> e i ; and further 

i, m m in 


A i « 1, > 0, e^ £ R q . Consequently 

v * A 1 e 1 + A g e 2 + A^e^ + \e 4 


and thus v C V which proves the assertion. Recalling that V is con¬ 
tained in the image of J' we can conclude that if R Q is compact then 
every element of R 2 has an inverse image in J'. Although In the general 
case, not every element of R g Is the image of an element of J', this 
will not be a serious handicap because of the context in which R 2 is 
utilized. 

The primary role of region R 2 is in the cooperative game in 
which pre-play communication is allowed. In this case the players must 
agree on a joint mixed strategy. Although Initially we took a rather gen¬ 
eral viewpoint it should now be clear that we can restrict the space J* 
to all normalized measures over the ring of sets of lx £ which consists 
of all sets with a finite number of elements. This effectively eliminates 
any worry over integrabllity conditions for the expression 

^axa (A( * ,(8) ' 

DEFINITION 8-b. Let J * (?) be the set of all 
normalized measures over the ring of sets of (La'S 
which consists of all sets with a finite number of 
elements. 


2.J. COMPOSITE ORDER RELATIONS- \ie no* shall define tvo partial 

OPd.plng8 of* . 
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DEFINITION 10-a. The element (x 2 ,y 2 ) composite- 
ly dominates (x 1 ,y 1 ), 

(x 1 ,y 1 ) < (x 2 ,y 2 ) ax, < x 2 , y 1 < y 2 and x, + y 1 < x 2 + y 2 . 

DEFINITION 10-b. The element (x 2 ,y 2 ) composite- 
ly uniformly dominates (x 1 ,y 1 ), 

(x 1 ,y 1 ) < (x 2 ,y 2 ) s x 1 < x 2 and y 1 < y 2 . 

The symbol < shall be construed as follows: 

(x 1 ,y 1 ) < (x 2 ,y 2 ) 5 x 1 < x 2 , < y 2 . 

An element e of the set U C is said to be maximal (<) 

if there exists no element e' G U such that e < e*. Similarly, we can 
define maximal «). In case d x 20 Is finite the sets of maximal 
« or <) elements of R Q , R 1 , and R 2 are non-vacuous. In the infinite 
case to insure that the above sets are non-vacuous. It is quite sufficient 
to impose a compactness condition on the set R Q . We state without proof 
(cf. Raiffa [ill for details) that the set of maximal (<) points of a 
compact and convex subset of is compact and connected. Hence, If 

R q Is bounded then the set of maximal (<) points of R 2 Is compact and 
connected, for: If R Q Is bounded then R g is compact and convex. 

Let the maximal (<) elements of R Q , R 1 , and R 2 be denoted 
by M Q , M 1 , and M 2 respectively. 

The element (£,>[) G Sj x Sjj is said to be admissible if it 
maps Into a maximal element of R 1 . The set of admissible elements, M 1 , 
is the Inverse image of M 1 . 

Let and (^ 2 ^,^ 2 ^) be two elements of Sj x Sjj. 

Then is said to be equivalent to (S^, 1 / 2 ^), — 

(2) (2) 1 

(s ST ) > i^ and only if they have the same image in R 1 (by mapping 

A x B). 


DEFINITION 11. An equivalence class, H, in 
3 I x S II is sat0 t)e P©rmutable if whenever 
(^(1)^0)) £|(2 )^j( 2)) ^ e i on g to H, also 

and belong to H. 

IEPINITION 12. The strategy i ^ C^°^I la sold 
tp be a Bayes solution with respect to the strategy 
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tj(°) [|(°)] (or, [rj^ 0 ^] is good against 

*l ( o) tt ( 0 ) l) if A(i< 0 ) ,V 0) )- SUP A(|,V°)) 

[B(i (o) ,H (o) ) - sup B(i (o) ,»|JJ. 4 

>) 

DEFINITION 15- The pair of strategies (|°,Y)°) 
is an equilibrium 1 point if each strategy is good 
against the other. If a pair of pure strategies, say 
(dJ°) ), is such that each is good against the 

other, then the pair is called a saddle point. The 
totality of saddle and equilibrium points of a given 
game will be denoted by E Q and E 1 respectively. 

To illustrate some of these definitions we return to the example 
given by Figure 1 . The strategy pairs (oC 1 ,p } ) and (d 2 ,P 2 ) are both 
admissible and saddle points. However, these elements are not equivalent. 
The strategy pair (^ 0 ^,^ 0 ^) where = (3/8,5/8) and T|^ 0 ^ = 

(l/4,3/4) Is an equilibrium point. The elements (2,1) and (1,2) are 
the maximal elements of the regions R q ana R 1 . The region R 2 is the 
minimal convex region containing R Q , which consists of the four vertices. 
The set M g of maximal elements of R g is the segment from (1,2) to 
( 2 , 1 ). 

2.4. STRICTLY COMPETITIVE, CONVEX AND LINEAR GAMES. We shall now 
consider an important subclass of two-person games which we shall call 
strictly competitive games. These games are characterized by the fact that 
the elements of R Q are incomparable in the composite ordering (<). If 
each player simply orders the terminal outcomes of the game according to 
preference, then in strictly competitive games the orderings of both players 
are exactly reverse. Hence the players have strictly opposing interests 
with respect to pairs of pure strategies. 

LEMMA 1. In a strictly competitive game the set 
E Q of saddle points (assuming E 0 / /) forms a per- 
mutable equivalence class. 

11 2 2 

PROOF. Let (cL ,R ) and (sn ,6 ) be a pair of saddle points. 

ii ' 

Since (cL ,0 ) is a saddle point we have 

a) A(eL 2 ,/J 1 ) i A«J , (S 1 ), Bfd. 1 ,P 2 ) < Bf* 1 ,fi') ■ 


k 


5fte concept of equilibrium point was first introduced by Nash, [4]. 
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Since the game is incomparable, we have from a) 
b) BCc*. 2 ,^ 1 ) > A'AfJ 2 ) > AC*. 1 ,^) . 


O O 

But (pk ) is a saddle point and thus 

C) A(e«. 2 ,0 2 ) > A(e*\|5 2 ), B(rt 2 ,|5 2 ) > B(A 2 ,/j’) . 

Prom b) and c) we have 

d) A(A 2 ,<3 2 ) > At* 1 ,/S 1 ), BU 2 ,(1 2 ) . 

Since the game is strictly competitive, both equalities must hold in d) and 
therefore equalities must hold in c), b) and a). Consequently, we have 

(d 1 ,** 1 ) =* (A 1 ,/* 2 ) ~ - (* 2 »/S 2 ) • Q.E.D. 


A strictly competitive game Is said to be convex if R Q C Mg 
(i.e., every element of R Q is maximal (<) in the set R 2 ). Thus in a 
convex game all pairs of pure strategies are compositely admissible. 

A strictly competitive game Is said to be linear if R 1 = R 2 = 
a segment of a line. Otherwise a game Is said to be non-linear. A linear 
game Is also convex, and also R 1 = M 2 . 

The concepts of strictly competitive, convex, and linear games 
are invariant under independent positive linear transformations of the 
payoff entries. The linear game is a natural generalization of a two-person 
zero-sum game. In a linear game no assumption need be made on a common 
unit of measurement between the two players. 

A game is said to have a non-cooperative solution if E 1 a M 1 
forms a permutable equivalence class. The imputation corresponding to this 
equivalence class will be called the value of the game. J. von Neumann*s 
solution of the zero-sum two-person game would be a non-cooperative solu- 
tion in our sense. 

If both players are aware of the above non-cooperative solution 
of a game (provided it exists) then there is no advantage for either player 
to act out of conformity with this solution. Furthermore, even if both 
players were permitted to enter a cooperative game without side payments 
and without correlated mixed strategies (but with pre-play communication) 


5 Por a more detailed treatment of the non-cooperative two-person game the 
above definition is too restrictive and is generalized in Ralffa [10). 
These definitions differ with those proposed by Nash [ 5 ]* 
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then there still would not be any composite motivation to move from this 
solution. 

If is such that max min A(£,*)) - min A(£^,fl) - v. 

SGSj «|6S n "I 6S II 

then |'°' and v 1 are said to be the maximin strategy and value respec¬ 
tively for player I. Similarly there will be a maximin strategy and 

maximin value v g for player II. The element (v 1 ,v 2 ) will be termed the 
composite maximin value . To show the dependence on a particular game 
we shall employ the symbolism (v^VgHfr). 

We also observe that if is an equilibrium point then 

(A(4 (1) ,1J (1) ), B(l (1) ,if (1) )) 2 <V V 2 ) 


where (Vj,v 2 ) is the composite maximin value. To verify the above asser¬ 
tion let be a maximin strategy. Now since is good against 

^ 1 ^ we have 

vi - min A($ (o) < A(£ (o) ,y| (1 )) £ A(^ l) ,rj (l )) . 

Similarly, v 2 < 1 ^ ,y^ 1 ^) which proves the assertion. 


2.5. REGION CORRESPONDING TO A TRANSFERABLE UTILITY. Thus far 
in Section 2 we have not assumed any common unit of measurement. However, 
if there exists a common unit of measurement and side payments are per¬ 
missible then it is possible for the players to achieve imputations outside 
of R 0 . Let c » max [A(d,fl) + B(d,0)]. In the infinite case this is 

assumed to exist. (For example, it is quite sufficient to assume compact¬ 
ness for CL and $ and continuity for A and B.) 


DEFINITION 16. Let - ((x^Xg) : x 1 + x 2 £ c). 

The set of maximal (£) points, M^, for R^ is 
t(x,,x 2 ) 5 x i + x 2 “ c). 

To summarize, we have defined four sets in E^ with the in- 
elusion relations R Q C R, C R g C R^. In the non-cooperative game and the 
cooperative game with independent mixed strategies we must consider R Q 
and Rj; in the cooperative case with dependent mixed strategies we must 
consider R 2 ; finally, R^ pertains to the cooperative game with side 
payments. 


i 3. THE COOPERATIVE GAME 


3•1• Bp using joint strategies $ G J, the players can come 
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arbitrarily close to any element of R 2 (indeed, if R Q is compact all 
elements of R 2 are attainable) . Hence, in the cooperative game with 
pre-play communication and without side payments, the.players should confine 
themselves to consideration only of the maximal elements. Mg, of R 2 , 
.since any element of R 2 not in Mg is compositely dominated by some ele¬ 
ment of Mg. Thus if Mg consists of one element the game is trivially 
resolved. However, if M 2 consists of more than one element then the 
elements of this set are compositely incomparable. Define the solution set 
of the game as the totality of elements of M 2 which dominate (£) the 
composite maximin value (v 1 ,v 2 ) of the game. Motivated by our discussion 
of Section 1 .1 we define a scheme of arbitration as a mapping & from a 
game into an element of the solution set. More specifically, we have: 

CONDITION 1. 3 : —> [V, C^,47), G 

where the game ft Is given by the payoff functions (A(<*,^3), B(<*,/9)). The 
pair [V 1 t V 2 (^,t7)] shall be termed the value of the game relative to 
the arbitration scheme 5 and this value shall be an element of the set^ 

M 2 , which in turn depends on ^. We wish the domain of the mapping to 
include (at least) all games with a finite number of pure strategies. 

CONDITION 2. For all a , [V, (*,{?), V 2 (4,tf)] > 

(v^Vgjy). 9 ° 

Condition 2 implies that the value of a zero-sum (linear) game 
relative to the convention £7 agrees with the von Neumann solution. 

It might seem natural to impose conditions on the mapping {J 
such that: if ^ has a non-cooperative solution in sense of 2.4 then the 
arbitrated solution shall agree with this result. If we consider the 
following game: 


0 , h 


2 S 

(1, io) 

(0, 0) 

*2 

(2,.01) 

(0, 0) 


we note that (2 ,.oi) is the non-cooperative solution, ((o,.oi) is the 
composite maximin value). However, if this game Is to be interpreted with 


If 9* is to be intezpreted as a game with a common unit of measurement 
and with side payments allowed, then in Condition 1 we replace “ 
with M^) 
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pre-play communication, player II can make a good case for something closer 
to (1,10) by threatening to play (not that II wants to actually play 

£ 2 ). Thus we see that even If the solution of the non-cooperative game is 
extremely stable It might not be a realistic solution in the case of pre- 
play communication because of the potential threat powers of the players. 

We now exhibit a rather general method for getting a mapping 47 
which has as its domain all games with a finite number of strategies. This 
domain can be enlarged, but the writer does not think it adds anything con¬ 
ceptually . 


Consider a family £f' * (T) of mappings, where each mapping T 
(generic symbol) has as its domain a region R 1 and as its range a set M 2 
(where R 1 and correspond to some game p) , i.e., T : R 1 —> > M g , 

such that T is point to point and 

a) T is continuous 

b) T(e) ^ e for all e £ R 1 

c) If T(e) = T(e') then Tfre + (1 - oOe') = T(e) - T(e‘) 
for e, e' £ R 1 and all 0 < °t < 1 such that <*e + (1 - <*)e' £ R 1 . We 
further assume that to each distinct pair (R 1 ,M 2 ) there exists one and 
only one T. 


For each game with regions R , M 2 (^) we have a ra &PPi n g 
T and we now consider the composite mapping: 


S I x s ll 423L -» R, - 2 -» m 2 


where 

(i,»|) —> (A(|,tj), B(|,^) —> T(X(£,lf), B($,ij)) = (A*(1,^), B'(g,f)) . 

Relative to the family 47', we associate to each game p = (A(d,(3) B(<*,0)) 
a new game * (A'(|,tj), B'(£,>|)). The set R Q of game is now con¬ 
tained in the set M 2 of The game is now a convex game and con¬ 

sequently if saddle points exist they form a perrautable equivalence class. 
Theorem 1, below, asserts that for all ^ with a finite number of pure 
strategies the Induced has a saddle point. The value of the game 

will now be termed the solution of ^ relative to the arbitration scheme 
Jp (we Identify the family of mappings with an arbitration mapping). The 
motivation for the above section should now be clear. Since we wish the 
arbitrated solution of (£ to be an element of M 2 (^) we induce a new game 
whose payoff values are all contained in M 2 (^). Thus, given a family 47' 
satisfying a) - c) above, we get an arbitration scheme which automatically 
fulfills Condition 1. The validity of Condition 2 follows from considera¬ 
tion of requirement b) for each mapping T of the family 47', as follows: 
If •g (o) ,v 1 are the maximin strategy and value for player I in ^ then 
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4 (o) guarantees a security value at least as large as v 1 in by 
property b) of T. Hence the composite maximin value (vj,v£) of is 

such that (vj ,v£) £ (v 1 ,v^ . We have also seen that the value correspond¬ 
ing to an equilibrium point is greater than or equal to (>) the composite 
maximin value- Hence we see that Condition 2 is satisfied. 

To prove Theorem l we will utilize the following lemma which was 
first proved by von Neumann, who utilized the Brouwer Fixed Point Theorem; 
it was later proved by Kakutani as an immediate consequence of the Kakutani 
Fixed Point Theorem (cf. Kakutani [2]). 


LEMMA. Let S^ and S n be two bounded, closed 
convex sets in Euclidean Spaces and R n respec¬ 

tively. If U and V are two closed subsets of 

x S . such that 
m n 

^(o) S( l ts n : <S (0) '7> euJ 

and 

V (o) 3 e S m ! <M (0)) C V) 

are both non-empty, closed and convex subsets of S n 
and respectively, for all £ S m and 

*| (o) € S n , then U n V / fi. 

THEOREM 1 . Let ^ be a two-person game with a 
finite number of pure strategies. Let be a family 

of mappings satisfying a) - c) above.' 7 The game 
induced by £j' .has at least one saddle point. 


PROOF. Let S m and S n be the probability spaces of players I 
and II respectively and let 


and 


U - K£,^) 


B *<M$ 


) = max 

1 




^Property c) of the T mapping is invoked to guarantee that the image seta 
of a point to set mapping shall be convex as required by the Kakutani 
Fixed-Point Theorem. Property c) could be weakened appropriately and the 
Eilenberg-Montgomery Fixed Point Theorem utilized, (cf. Ellenberg, S., 
and Montgomery, D-, [1] .) G. Debreu lias recently proved a saddle-point 
theorem using the Eilenberg-Montgomery results (unpublished). 
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V - Uiytf) : A*(^,)J) - max A’(|,*|)) . 

That is, U is the set of elements (|,t]j) for which r| is "good against" 

| relative to the game ^'; and V is the set of elements for 

which £ is "good against" relative to the game Since the mapping 

T [(A x B)(g’,i})] is continuous on S m x S n it follows that U is closed. 
Similarly V is closed. The set 


U 


(o) 


<Y 0) i| 

is non-empty and closed because of the compactness of 


B '(§ (0) '^(o) 


max 


tinuity considerations 
belong to U 


As regards convexity, let ^(o) 


Ao) 


,rj) = m Q . Then 


^ 0 ) and let max B'(£' 

T [(A x B) (f (o) ,rj* (o) ) I - T [(A x B)(£ (o) ,»}'( o) )] = tt Q . 
of mapping T, and the restricted linearity of A x B 


and from con- 
and yjo) both 


Prom property c) 
it follows that 


T [ (A x B) (£ 


(o) 


*^( 0 ) 


(1 


*\{o) 


+ (1 
belongs to 




nu and thus 


£ 


(o) ■ 


Similarly, the set 


,<o) 


( ^(°) 


A,( ^(o) ,Y l (0)) 


max A' (£,T)^)) 


is non-empty, closed and convex. Consequently, U nV^. Let 
(^° i 1 ] 0 ) € U a V. Then is "good against" Y)^ and 

and therefore (^°^,*p 0 ^) is a saddle point. 


) G U a V. 

j(0) 


is 

"good against" £ vuy and therefore is a saddle point. Q.E.D. 

If ^ is a linear game then the appropriate T mapping for (jf 
is the identity mapping (follows from condition b); and, consequently, as a 
corollary to the above theorem we have that all finite linear games have a 
non-cooperative solution. 

We will show that the family O' of T mappings satisfying 
properties a) - c) is non-empty by considering various specific O' con¬ 
ventions. If there exists a common unit of measurement and side payments 
are permissible then let O' * (T) where each T : R 1 —> M^. The induced 
game Is then a constant-sum game and by the same argument has a saddle 

point; again these saddle points form a permutable equivalence class which 
yields the arbitrated solution relative to the convention O' • 


3 .2. If a slight perturbation of the payoff entries would result 
in a drastic change in the arbitrated solution, then the convention would 
not be stable enough to be practical. After all, the payoff entries are at 
best only hazy appraisals of the possible terminal outcomes of the game. 

The desire to capture this continuity notion motivates this section. 

« Let ^ « {(A(d,£), B(<*,£))} be a game defined over the product 



ARBITRATION SCHEMES 


375 


space of pure strategies (L x 10. A sequence of games 


ffk m B k (cA,/3))) 

each defined over <L x is said to converge to the game p if for each 
(<*,0) € & x 0 it follows that 11m (A k (<*,£), = (A(o<,p), B(*,p)). 

k / 2 ) 

A sequence of sets (H k ) in E v ' is said to converge to the 
set H provided for every h £ H, there exists a sequence of elements 
h k £ H k such that lim h k = h; and, conversely, for every h' which 
belongs to the complement of H there is a neighborhood of h' which 
intersects at most a finite number of H k » 

If the sequence of games {^ k ) converges to the game ^ then 
the sequences of sets R Q , R 1 , R 2 , R^ of converge to R Q , R 1 , R 2 , R ? 

of ^ respectively. However, it does not follow that the sequences of 
sets M q , M 1 , M 2 of ^ k converge to M Q , M 1 , M 2 of ^ respectively. 


CONDITION 3- If the sequence (^ k ) converges to 
p such that converges to M 2 (^) then 

lim [^(^,^7), V 2 (^ k ,^7)] = [V } (p3), V 2 (^,5T)] . 

An arbitration scheme & satisfying Condition 3 will be called stable . 
From consideration of the sequences of games l* k ), , 




which both approach the same game one can readily see the dilemma to 

be faced in deciding on a convention with continuity properties. For this 
reason we require convergence of to 111 Condition 

If the arbitration scheme £ is to be identified with a family 
3 = (T) of mappings, then stability of 47 requires a bond between the 
mappings T of the family 

3«3« The game = ((C(£,cO, D(0,dO)} defined over J6 x (L will 
be said to be the transpose of the game ^ = {(A(<*,0), B(<*,p))} defined 
over d x t> provided that C(p,«0 = B (&,(>) and D(p,<*) - A(<*,p). Thus the 
transpose of a game results from an interchange of the roles of the players. 

CONDITION k . [V 1 (pQ ), V 2 (^,tf) ] - 
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Vl (^)] for all ^ in the domain of the 
mapping An arbitration scheme, V> satisfying 
Condition h will be said to be symmetric . 

3.^. We indicated in Section 1 .2 tliat we would require our 
theory to be invariant up to various utility transformations, and, further, 
that we would distinguish between the cases of a common and a non-common 
unit of measurement. We first take up the case of the common unit of 
measurement. 

Let U Q be a 1 <—> 1 transformation of onto itself 

which takes the following form: for each U Q there exists a real number 
A> 0 and two reals c 1 , c 2 such that 

U Q (x,y) = (Ax + c 1 ,Ay + c 2 ) . 

A transformation U Q of the above form is said to be a utility transforma¬ 
tion preserving the common unit. 

CONDITION 5A. (V, (U G 0,$), V 2 (U Q ^,5)] = 

V 2 (£,#)], for all ft in the domain of the 
mapping and all utility transformations, U Q , 

preserving the common unit; where 

U 0 ^ S U 0 1(A(<*,£), B(*,p))) s (U 0 (A(*,j», B(dL,f>))) . 

An arbitration mapping if satisfying Condition 5A Is 
said to be invariant up to a common unit of measurement. 

3.5* We shall confine ourselves to the discussion of conventions 
for which the arbitrated solution Is invariant with respect to any permuta¬ 
tions of the pure strategies of (L and 20. All conventions will be 
understood to have this invariance property. If permutations [by a permu¬ 
tation of a (possibly) infinite set of elements we mean a l-l mapping of 
the set onto itself] of the elements of (L and 28 send dk into <** and 
P into then we shall let the game induced by these permutations be 

- ((A*(a*,p*h B*(d*,p*))) - ((A(<*,0), B(*,p))} . 

CONDITION 6. If is a game induced from 

defined over CUx tf, by permutations of the elements 
of d and ® then 


CV^Str), V 2 (£*,tf) ] - CV 1 <^,40, V 2 (^)] • 



ARBITRATION SCHEMES 


377 


A game Qr with a common unit of measurement is said to be sym¬ 
metric if there exist permutations of & and inducing the game <£* 
and a utility transformation U Q such that U Q f* is its own transpose. 

If f is symmetric then there exists a value c such that the regions 
R 0 , Rt > R 2 of are symmetric about the line through (o,c) with direc¬ 
tion numbers ( 1 , 1 ). For example, the game 

* 

«l, (2, 0) 

b* 

(- 10 , - 11 ) 

is symmetric (permute (o^ ,<* 2 ) to (o^,®^) and let U Q (x,y) = (x - l,y)). 
For any arbitration scheme *7 satisfying Conditions 1, 4, 5A, 6, the arbi¬ 
trated value for is ( 3 / 2 , 1 / 2 ) . 

It should be noted that a game ^ may be asymmetric although R Q , 
R 1 , and R 2 of p may be symmetric about some line with direction numbers 
(1,1). An example of such a game is ^ of Section 2.1 whose region R ] 
is given In Figure 1 . 1 

3-6. In this section we shall give an example of an arbitration 
scheme, *J Q , satisfying Conditions 1, 2, 3 , 4, 5 A, and 6. We shall 
identify # Q with a family of mappings IT Q ) satisfying a) - c) of 
Section 3-1• We shall first characterize the arbitrated solution for the 
finite case and then Indicate some generalizations to the infinite case. 

Let ^ have regions R Q , R 1 , R 2 - Corresponding to the game ^ 
we shall define the point to point mapping T Q : R 1 —> M g . First define 
T q for a subset Q of R 2 • Let e G Q if there exists an e' G Mg such 
that the ray e to e' has direction numbers ( 1 , 1 ) and then define 
T Q (e) = e». Now extend the mapping T Q from Q to R 2 by requiring that 
for every e' £ M 2 the set (e G R ? : T Q (e) = e') is connected. This 
extension Is unique and thus T Q is uniquely defined on R g . Now restrict 
the domain to R 1 and note that T Q satisfies conditions a) - c) of 
Section 3■1. 

Let us consider the zero-sum game with payoff K(oc,0) = 

A(cl,|£) - B(d,fi) and let us assume that this game has a minimax solution 
(v, 4 -v) with generic optimal strategies and . By the linearity 

of operators A and B we then have A(^°^,x|) - B(^ 0 ^,*?) > v for all if 
and A($,*| (o) ) - B(|,T) (o) ) < v for all and A(| (o) ,»| (o) ) - 

B(|^ 0 ^ ) + v. Hence, all elements of the form 

(A(£ (o) ,V 0) >. B(£ (0) ,>1 (0) )) 


h 

(- 10 , - 11 ) 

0, 1 ) 
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where are pairs of optimal strategies of K(<*,0), lie on a 

ray r Q , with direction numbers (1,1)- By referring to Figure 2 it should 
be clear that depending on the -value of v, the ray r Q may or may not 
intersect ML. 

If we define T v ' and T v ' (corresponding to T) by the re- 
latlon T(A x B)(|,*t) - [T (,) (A x B)(|,tj), T (2) (A x B)(|,*|)] and If 
r 0 0 M 2 ^ then for the mapping T Q we have 

(A x B)(| (o) ,»|) - t£ 2) (A x B)(| (o) ,’T)) > v, all >) 

and 

(A x BXi,»| <0) ) - t£ 2) (A x B)(|,>] (o) ) < v, all 

Consequently if r Q n Mg ^ then the intersection defines some element, 
say (m^mg), which is the arbitrated solution of the game relative to 
the convention £ Q . By choice of a player I gets at least m 1 and 

by choice of an TJ^° , player II gets at least m 2 . By the Incompara¬ 
bility of the elements of Mg, this is an equilibrium situation. If 
r Q n Mg * ^ then the arbitrated solution is one of the end points of the 
continuum Mg which is closest to the ray r Q . 

For all finite games the above characterization determines the 
value [ Vl (^ 0 ), V 2^^o^ and in these cases the value of the corres¬ 
ponding zero-sum game can be actually computed. 

The above characterization for & Q can now be generalized to a 
wide class of infinite games provided the zero-sum game K(<x,0) = 

A(c*,0) - B(*,jB) is strictly determined in the sense of Wald [12] or 
Karlin [ 5 ]. In general, the arbitrated solution will not be attainable; 
however, the solution (if It exists) can be approximated arbitrarily close 
by the players using a joint strategy which utilizes at most two pairs of 
pure strategies. 

We have already indicated that a family of mappings satisfying 
a) - c) can be Identified with an arbitration scheme satisfying Conditions 
1 and 2. To verify Condition 3 let fa - ((A k (<*,/8), B^oC,^))) approach 
l(A(<*,p), B(«t,|J))}. If v k is the value of the zero-sum game 
A k (c*,|&) - ^(<*,0) then we have lim v^ - v and If we hypothesize lMg(| lc )} 
approaches Mg(^) then stability of follows from the characterization 
of the arbitrated solution. To verify Condition 4 we note that if K(<*,/6) 
is the zero-sum game associated with |? and K*'(<*,£) is the zero-sum game 
associated with (j^ then K^(^,«k) ® - K(<*,/J) and consequently the value 
of the game £^(£,<4) is (-v,v). If we now take the reflection of R 2 (^) 
with respect to the line y - * then we get the region R 2 (^ t ) • The ray 
r Q * through (v,o) reflects into the ray which goes through (-v,o). 



ARBITRATION SCHEMES 


379 


still with slop© +1 . Again from the characterization of the arbitrated 

solution relative to we have indicated the validity of Condition k. 

If we apply the utility transformation U Q to R 2 (^) then this region is 

translated and stretched but not rotated. The transformed ray U (r ) 

0 o 

still has slope +1 and an x-intercept which corresponds to the value of 
the zero-sum game induced by U Q ^. Hence Condition 5A is valid. Condi¬ 
tion 6 follows from knowledge that both Rg(^) and the value of the zero- 
sum game, remain invariant with respect to permutations of pure 

strategies. 

We now consider a further rationalization (metatheoretic) for 
convention V Q besides the ones already mentioned. 

We first note that the ray r Q partitions R 2 into two regions 
denoted by Q 1 and Qg in the accompanying figure, viz: 



Figure 2 


Let us consider the actual bargaining situation involved in this game. If 
both players are aware of the region R 2 and agree to confine their cooper¬ 
ative behavior to consideration only of elements of M 2 , then player II 
desires point F and player I desires point E. In the ensuing argument 
each player intimidates his opponent by threatening to play non-coopera- 
tively unless his opponent will agree to his terms. In jockeying about for 
bargaining advantage a threat by player I to minimize player II*s maximum 
possible gain is not very convincing if at the same time player I has to 
suffer "more than" player II. For example, if player II desires point x 
of Mg (cf. figure) then player I can choose a strategy which will 

guarantee an imputation on r Q or in Q 1 . Consequently, relative to the 
point x player II has "more to lose" than player I in a threat of this 
variety. 8 If player I wishes point y then by the choice of an 


8 Even though we postulate a common unit of measurement there is no possi¬ 
bility of formalizing these statements within the undefined terms of the 
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player II can confine the result of the non-cooperative game to r Q or Qg 
and thus relatively inflict "a heavier loss" on player I than upon himself. 8 
Thus in the argumentative stage the players threaten to play the non-coop¬ 
erative relative game — i.e., they consider entries of the form 
(A(*,£) - B(ot,/5)). At point C neither player has a bargaining advantage 
and the corresponding imputation is the arbitrated solution relative to the 
convention %J Q . 

In the case side payments are permissible then the arbitrated 
solution relative to 3 Q has a particularly simple characterization, viz: 

V^ 0 ) - “ value of zero-sum game A(ot,/6) - B(«*,|3) 

v l(f.Jfo } + V 2 ( ^o } == ( ® l ^ ) + . 

Returning to game ^ of Section 2.1, we have 

EVfl’tfo)' V 2 (^1^ 0 )] - (2,0 • 

In this case player I has the bargaining advantage. We also notice that in 
[fiy] is the Bayes solution against the maxlmin strategy [£^] 

of player II [I] and further (olp^) is a saddle point yielding (2,1). 

3*7• If the g&me ^ is to be interpreted without a common unit 
of measurement then we wish the theory to be invariant up to independent 
linear transformations on the pavoff entries. To this end, let U 1 be a 
1 <—> 1 transformation of E^ 2 onto itself which takes the following 
form: for each U 1 , there exists positive real numbers A 1 , A 2 and 
arbitrary reals c 1 , c 2 such that 

U^J^y) 88 + C^A^ + C 2* • 

CONDITION 5B. Vg (11^,3)] - 

TJy[Vy{f,3) $ V 2 (^,3)] for all ^ in the domain of the 

mapping 3» and all utility transformations U 1 . 

A game understood in the sense of a non-common unit, is said 
to be symmetric provided there exist permutations of the elements of (L 
and B, inducing game a*, and a utility transformation U 1 such that 


utility theory mentioned in Section 1.2. We have gone outside our formal 
framework to obtain a rationalization of a procedure satisfying our formal 
requirements. A realistic realization of this rationalization occurs in 
the case of the monetary payoff. 
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U^* is its own transpose. All arbitration schemes & satisfying 
Conditions 1 , 2 , 3 , 4, 5B, 6 arbitrate symmetric games in the same way. 

3-8. We shall now exhibit a family « (T 1 ) of mappings such 
that the corresponding arbitration scheme satisfies Conditions l, 2, 3 , k, 
5B, 6 . The writer’s motivation for this family of mappings will be given 
in Section 3- 10. 9 

Let ^ be any game with a finite number of pure strategies. 
Define the mapping T 1 : R 1 (^) —■> Mg(^) as follows: First define T 1 
for a subset Q C Rg. Let e G Q if there exists an e* G Mg and 
e' ( R Q such that the ray from e to e' is the negative of the slope of 
Mg at e'. Then let T^e) - e'. Now extend T 1 to all of Rg such 
that T 1 Is continuous and the inverse image of any element of Mg Is a 
connected point set. This extension is unique and thus T 1 is uniquely 
defined on Rg. Now restrict the domain of T 1 to R 1 . 

Since the negative of the slope of any segment of Mg is posi¬ 
tive, Condition b) of Section 3*1 is satisfied. Conditions a) and c) are 
obviously satisfied. Hence we can utilize Theorem 1 to show the existence 
of a saddle point. Since all saddle points form a permutable equivalence 
class we define the common value to be [V 1 (^,4^), Vg(^,^)]. 

In order to prove that ^ satisfies the necessary desiderata we 
shall first find a characterization of the above arbitrated solution . 10 
Let P 1 , Pg, ..., P t be the vertices of Mg(^) where P i = (c^d^) and 

c 1 < c 2 < ... < c t . Let the open one-simplex (P.^ ,P.£) denoted by 

and let be the slope of Thus < 0. Let v 1 be the value of 

the zero-sum game (A(c*,{>) + 77 - B(<A, 6 )}. Hence there exist optimal strate- 

^*1 

gles and rj^ such that 

( 3 - 8 . 1 ) A(£ ( 1 ) ,rj) + ± B(| ( 1 ) ,i|) > v i , all ij C S n , 

(5-8.2) A(|,tl (1) ) + ^ B($,i| (1) ) < T lf all $ £ Sj ; 

or since < 0 , 

( 5 . 8 . 5 ) B(| (1) >*1) < - M 1 A(| (1) ,y\) + all Tj 6 Sjj , 


^J. F. Nash, Jr. has utilized the same family of mappings. 

10 In Ralffa [10] scheme 4T. is reduced by successive utility transforma¬ 
tions to considerations of scheme £ . The following procedure is 
different and proceeds in a manner suggested by R. M. Thrall. 
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(3-8.4) B(|,>J (1) ) > - A(g,t| (1) ) + ^ 1 v ± , all $ 6 Sj . 

Conversely, If there exist and satisfying the equations 

(3.8.5) B(£ ( 1 ) ,^j) < - M t A(g (1) ,»|) + J, all r| 6 S n 

( 3 - 8 . 6 ) B(£,*| (1) ) l - A(f,t} (i) ) + 4, all §6 3.,. 

then are optimal strategies and is the value of the game 

(A(*,(i) + jJ- B(d,£)}. 

1 

Let r^ be the line y = - A^x + Ai^v.^. We shall now cite three 
mutually exhaustive.cases. 

CASE 1 • a) If [V, V 2 (a,^)] 6 <r A then r ± n <r ± = 

KV, (^,5,), v 2 (^,))). 

b) If r i n 0-^ / ?! then r 1 n = 

([V^^J,), V 2 (^,))). 

Regarding a): By definition of the saddle point of the game 
(T 1 [A(£,Tj), B(|,v))]) we can verify that there exist a and 

satisfying 3»8-5 and 3 . 8.6 with 4 = V 2 (^,^) + 1 )- Hence we 

conclude T ” 1 [V, V 2 (fJ,)] C r ± . 

Regarding b): If r^ n <r^ / # then player I [II] can confine 

player II [I] to the region R ] below [above] or on r^ hence b) follows. 

CASE 2 . UV^,^), V^))} - P ± (i - 2, 3, t - 1) if 

and only if there exist no element of (below r i and no element of 
(T 1+1 above r i+1 . 

The element is a solution of the arbitrated game relative 

to if and only If in the non-cooperative game player I can confine 

player II (cf. Figure 3 ) in the region on or below line f and player II 
can confine player I In the region on or above line g. Noting that r 1 
Is parallel to f and r i+1 Is parallel to g. Case 2 follows. 



Figure 3 
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CASE 3. 

a) 

(IV, (f.*,). = P, 

If and only if no point 

of Mg 

lies above 

r i ' 




b) 

v 2 (^<r,)n = P t 

if and only if no point 

of Mg 

lies below 

r t- 

■1 • 



For player II to get the arbitrated solution value of d. It Is 

( I \ * 

necessary and sufficient that he have available a strategy tj v ; which 
confines the returns of the players in the non-cooperative game on or above 
the line through P 1 with slope - This is possible if and only if no 

point of M 2 lies above r 1 . Part b) is similarly proved. 

Conditions 1 , 2, and 6 are immediately satisfied. If ifa) 
approaches ^ then the lines r g , —, r t defined above for game 
approach the lines r£, ..., r£ for the game Since we have character¬ 

ized the arbitrated solution in terms of these lines and the maximal ele¬ 
ments, stability of 47, follows. Consider the game ^ with region R 1 
decomposed into equivalence classes induced by mapping 1,(6 is equivalent 
to e* if T(e) = T(e')). The region R, of (j^ together with its 
equivalence classes is the reflection of R, if) about the line y = x 
since a line with slope m gets mapped by the reflection into a line with 
slope -. Prom this, symmetry of the mapping 47, follows. Finally if 
U, (x,y) = (A,x + c,, A 2 x + c 2 ) then a line with slope m gets mapped by 

U- into a line of slope ^ m. Hence if the slope of one line is the 
1 1 

negative of the slope of another line, then this property is preserved 
under utility transformations. From this It follows that equivalence 
classes of R, (^) get mapped by U, into equivalence classes of R, (U,^) 
thus giving Condition 5B. We have thus verified that ,47, satisfies our 
imposed conditions. 

If we arbitrate ^ 2 of Section 3.1 we get 

i )] “ C-°°5, 9-995) • 

If, however, we can Interpret ^ 2 with a common unit of measurement then 

[V l ( f2^o^ V 2 ( f2^o )] " (1 - 82 ' 1 ’ 82) * 

3 . 9 . In order to show that there exist other arbitration conven¬ 
tions satisfying our conditions we will exhibit another scheme, 11 4T 2 * Let 

A(dl,£), = sup tA(<*,£) - c.], 

A 1 (*,£) 1 


^ - ((A(*,f>), B(<A,0))) and define c, 


= inf 


11 The following scheme has some serious objections In that it is not sensi¬ 
tive enough to intermediate values of the payoff entries. The problem is 
open how to impose a further condition which would rule out & 2 but not 
uniquely imply 47, . # 
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assume that c 


t 0 - Inf B(a,£), 4- * sxip CB(*,£) - c p ]. We explicitly 
2 (*,£) *2 (a,*) 2 r , 

and Cg are finite. Since in the case that sup [A(<A,p) - c 1 ] or 
sup [B(d,p) - Cg] equals zero the game is trivial, we will rule out this 
possibility. Now for the game, define the normalizing utility trans¬ 

formation tf(x,y) - (Aj(x - Cj), Ag(y - c 2 )). The utility transformation 
U normalizes the players' entries in the sense that ( if the infs and sups 
are attained) the entries 1 and 0 refer to the maximum and minimum that 
each player can possibly get from the game. We now shall define the scheme 


3g, whose domain consists of all ^ such that 
the mapping if • In particular, let 12 


is in the domain of 


tV^tfg), v 2 


j,J 2 ) ] 


T I 


[V, (Vfl,3 Q ), V 2 (U|,J 0 )1 


where U is the normalizing transformation which depends on 
troublesome conditions to verify are Conditions b and 5B. 


The 


tion 


r 


To prove symmetry of # 2 , 
and let W(x,y) * (y,x). 


let U t be the normalizing transforma- 


identitles: li 


W U W or 


_ 1 
u t 


It is then easy to verify the following 

s 1 **/ +■ 4 - 

T -1 ,_r (U ^)i = 


W U“' W and 


We then have 


IV^), v 8 <fV 2 >] - uf tv, (U t f^ 0 ), v 2 (u t ^^ 0 )] 

- WU _1 W tV 1 ((U^) t ,^ 0 ), V 2 ((U^) t ,5 0 )] 
“ W U -1 [V,(tJ^ 0 ), V 2 (U^ 0 )] 


- w [v,(^,^r 2 ), v 2 (^,ir 2 )] 

- fv 2 (^r 2 ), v,(^,ff 2 )i . 


To prove Condition 5B, let U 1 be an arbitrary utility trans¬ 
formation of ^ and let U and U 1 be the normalizing utility transforma¬ 
tions of f' and respectively. Noting that U « U 1 U 1 and 

U" 1 « TJ, U~' we then have 

<V U VM ”^ 3 -v;' [V,(u,u,^ 0 ), v 2 (u,u,^ir 0 )] 

- U,U _1 tv, (Uf,# 0 ), V s (Vf,# 0 ) ) 

- u, tv,(^r 2 ), v 2 (^r 2 )l . 

- -4 1 

12 We can also define a family of>'mappings - (T 2 ) where 

Tg(e) - U _1 T 0 U(e). 
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If we arbitrate fy 2 of Section 3.1 by convention if 2 we get the 
solution 200 / 3 ) which seems (to the writer!) more realistic than 

the value ( 1 . 005 , 9.995)* 

3.10. The author's original motivation for convention stems 

from a linear approximation of the non-linear family of mappings to be 
indicated in this section. 

Let us consider a game ^ with an R 2 of the following form 
(R 2 is bounded by (C, D, E, F, G, H)): 



Let the locus of Mg(^) be given by (x 1 ,f(x 1 )) for E 1 < x 1 < H 1 or 
{x 2 ) ,x 2 ) for H 2 < x 2 < E 2 . Consider a point e = (e^eg) in the 
subregion (F, L, G) . We wish to map e into some element of the segment 
e' *= (f" 1 (e 2 ),e 2 ) to e" = (e 1 ,f(e 1 )). If we desire a symmetric conven¬ 
tion it is quite natural to map e into 

e- + e" / f 1 (® 2 ) + e, e a + f(e,)^ 

2 “ \ 2 ’ 2 / * 

It is also evident that this mapping will be invariant with respect to 
utility transformations. With this rationale we can now define the mapping 
from subregions (E, K, F), (F, L, G) and (G, M, H) onto the maximal ele¬ 
ments. In the family of mappings we merely extend linearly the linear 

equivalence classes of the above subregions. Now instead of a linear ex¬ 
tension we propose the following: decompose the region Rg into equivalence 
classes through the medium of the differential equation 
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dx 2 f(x 1 ) - Xg 

dx l f -1 (x 2 ) - x 1 

where we use the convention that f(x.,) « E 2 for x 1 < E 1 and 
f^tXg) ■ H 1 if x 2 < H 2 . Notice that the induced mapping agrees with the 
mapping tf } on regions (E, K, F), (P, L, G) and (G, M, H). It is obvious 
that the mapping via the differential equation can be generalized to a wide 
class of games with an infinite number of pure strategies. If the region 
R 2 is bounded, the elements E and H are the non-cut points of the 
continuum Mg(^) . Although this family of mappings is perhaps more realis¬ 
tic (subjective opinion) than the families ^ and 3 2 it has the serious 
handicap that the equivalence classes of R 2 are In general non-linear. 

In the existence theorem, this non-linearity is reflected in non-convexity 
of certain sets which prohibits the use of the Kakutani Fixed Point Theo¬ 
rem. 15 The existence of an arbitrated solution for this non-linear con¬ 
vention, with the support of a computational technique will be left as an 
open question in this paper. 
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